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CHAPTER  I 

INTRODUCTION  AND  OVERVIEW 

Since  the  late  1960s,  the  United  States  Air  Force 
acquisition  community  has  become  increasingly  concerned 
with  cost  growth  and  resource  allocation.  The  principal 
factors  which  led  to  this  concern  include  the  following: 

(1)  weapon  systems  have  become  increasingly  complex  and 
the  resultant  cost  growth  tends  to  undermine  public  and 
Congressional  confidence  in  the  procurement  process  as 
managed  by  the  Air  Force;  (2)  competing  needs  for 
resources  have  led  to  the  requirement  that  each  need  be 
assessed  more  accurately  to  allow  equitable  allocation  of 
resources  among  defense  and  other  projects;  and,  (3)  there 
has  been  a  tendency  to  reduce  quantities  when  costs 
increase,  thereby  mandating  purchasing  techniques  which 
forecast  final  prices  more  realistically  (25:1-1). 

This  research  will  focus  on  developing  more  flex¬ 
ible  cost  and  price  estimates  through  improvement  in 
direct  labor  cost-estimating  models.  Such  improvements 
can  help  trim  the  commitment  and  expenditure  of  many 
dollars,  and  the  improvements  can  help  eliminate,  or  at 
least  reduce,  the  public  and  Congressional  perception  that 
expenditures  beyond  those  anticipated  result  from 
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mismanagement  of  Air  Force  acquisition  dollars.  Finally, 
this  research,  in  aiming  at  better  forecasts,  addresses 
the  effect  of  production  rate  changes  on  direct  labor 
requirements. 


Limiting  the  Problem 

During  the  Department  of  Defense  (DOD)  acquisition 
process,  complex  cost  estimates  are  required  for  many 
activities.  Examples  of  these  activities  include  the 
following;  (1)  procurement  planning;  to  evaluate  the 
cost  likely  to  result  from  newly-proposed  programs; 

(2)  contract  pricing;  to  establish  negotiation  objectives 
and  determine  fair  and  reasonable  prices;  and,  (3)  con¬ 
tract  administering;  to  measure  progress  and  compare 
planned  versus  actual  costs  to  date  (10 ;1S4-155) .  Because 
of  the  importance  of  obtaining  accurate  cost  estimates 
within  each  of  these  activities,  improvement  in  cost  esti¬ 
mating  techniques  has  been  a  major  objective  of  PROJECT 
COPPER  IMPACT  II,  the  Air  Force  plan  to  improve  modern 
pricing  techniques  (23 ; 2 , 36 , 40-41) . 

One  approach  for  production  cost  estimating  used 
extensively  within  DOD  is  the  learning  curve  model 
(10;46S).  The  learning  curve  model  is  based  on  several 
key  assumptions. 1  These  assumptions  or  preconditions 

_ _  e 

1-The  assumptions  of  learning  curve  models  and  the 
questions  by  some  investigators  about  linearity  are  beyond 
the  scope  of  this  research. 
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include  the  following:  (1)  the  production  process  is 
characterized  by  a  high  proportion  of  manual  labor; 

(2)  the  production  is  uninterrupted;  (3)  tHe  production  is 
that  of  complex  items  and  is  characterized  by  repetitive 
tasks;  (4)  there  are  no  major  technological  changes  during 
the  production  run;  (5)  there  is  continuous  pressure 
and/or  desire  to  improve;  (6)  carry-over  knowledge  is 
either  not  present  or  if  present  is  taken  into  account; 
and  (7)  there  are  no  exogenously  introduced  production 
rate  changes  (11:234;  15:135).  This  final  assumption,  the 
absence  of  production  rate  changes,  has  been  the  focal 
point  for  considerable  research  in  attempting  to  improve 
the  accuracy  and  flexibility  of  learning  curve  models  in 
estimating  direct  labor  requirements.  This  research  was 
prompted  by  the  lack  of  systematic  consideration  of  pro¬ 
duction  rate  changes  by  the  learning  curve  model. 

A  variation  of  the  standard  learning  curve  model 
which  does  consider  changes  in  the  production  rate  is  a 
cumulative  production  and  production  rate  model. ^  The 
use  of  a  cumulative  production  and  production  rate  model 
has  resulted  in  a  significant  increase  in  accuracy  of  pre¬ 
dicted  costs  for  direct  labor  requirements  in  the  airframe 
manufacturing  industry.  These  findings,  to  be  discussed 
in  the  literature  review,  have  resulted  from 

2 

A  cumulative  production  and  production  rate 
model  is  a  learning  curve  model  which  includes  a  second 
independent  variable,  namely  production  rate. 


investigations  like  those  by  Colasuonno,  Johnson,  Orsini, 
Smith,  and  Congleton  and  Kinton. 

Like  the  basic  learning  curve  model,  a  cumulative 
production  and  production  rate  model  should  apply  to  esti 
mating  direct  labor  requirements  in  industries  other  than 
airframe  manufacturing.  Herein  lies  the  problem  for 
research. 


Research  Problem  Statement 
The  applicability  of  a  cumulative  production  and 
production  rate  model  for  estimating  direct  labor  require 
ments  for  nonairframe  products,  such  as  avionics,  is  not 
known. 


Research  Objectives 

The  objectives  of  this  research  are;  (1)  to  deter 
mine  if  there  is  an  effect  by  production  rate  changes  on 
production  direct  labor  requirements  for  avionics  produc¬ 
tion,  and  (2)  to  evaluate  the  predictive  ability  of  a 
cumulative  production  and  production  rate  model  for 
eighteen  months  into  the  future.  These  objectives  are 
specified  by  the  Air  Force  Plan,  COPPER  IMPACT  II,  and 
sponsored  by  the  Air  Force  Business  Research  Management 
Center  at  Wright-Patterson  Air  Force  Base,  Ohio.  In 
meeting  these  objectives,  additional  information  relevant 
to  the  scope  and  applicability  of  the  model 'will  be 
revealed. 
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Overview 


With  the  problem  narrowed  and  the  objectives  out¬ 
lined,  the  next  chapter  is  devoted  to  a  review  of  past 
research  approaches  and  findings.  Chapter  III  will 
discuss  the  research  hypotheses  and  the  methodology  for 
testing  these  hypotheses.  A  brief  summary  of  assumptions 
and  limitations  about  methodology  will  close  chapter  III. 
Chapter  IV  will  discuss  data  analysis  and  evaluation. 
Finally,  Chapter  V  will  contain  the  summary,  conclusions, 
and  recommendations  of  this  research. 


CHAPTER  II 


A  HISTORY  OF  LABOR  REQUIREMENT 
ESTIMATING  MODELS 


This  chapter  traces  a  necessarily  abbreviated 
history  and  development  of  traditional  learning  curve 
models  over  the  past  fifty  years  and  more.  Of  particular 
interest,  of  course,  are  the  recent  models  investigated  by 
Johnson,  Orsini,  Smith,  and  Congleton  and  Kinton.  The 
results  of  those  investigations,  to  be  discussed  momen¬ 
tarily,  were  compatible.  That  compatibility  justifies  this 
research.  Smith's  investigations  receive  particular 
attention  since  they  form  the  basis  for  this  replication 
of  his  model  and  its  extension  to  avionics  production. 

The  Early  Years 

This  section  outlines  a  chronological  history  of 
learning  curved  models.  While  not  exhaustive,  the  outline 
is  intended  to  provide  one  view  of  why  learning  curves 
have  flourished. 

^The  term  "learning  curve"  is  used  in  this  research 
rather  than  any  of  the  alternative  terms  because  the  term 
"learning  curve"  is  common  in  the  United  States  Air  Force 
and  the  preponderance  of  the  literature  reviewed.  More 
importantly,  however,  "learning  curve"  is  njuch  more 
restricted  than  are  broader  concepts,  such  as  "improvement 
curve"  and  "experience  curve,"  as  discussed  by  Cochran 
(6:63-66)  and  Cheney  (5:1-3),  respectively. 

6 


T.  P.  Wright  of  the  Curtiss-Wr ight  Corporation  is 
generally  regarded  as  the  pioneer  of  learning  curves 
(6:49).  He  began  his  research  as  early  as  1922  (5:48). 
Shortly  thereafter,  reports  of  the  use  of  learning  curves 
were  recorded.  By  1925  learning  curve  tables  were  being 
used  at  McCook  Field,  Dayton, Ohio  (6:50).  In  1930  Boeing 
used  log-log  cost  trends  during  its  negotiations  with  the 
Bureau  of  Aeronautics  (6:50). 

In  February  1936,  T.  P.  Wright's  article,  "Factors 
Affecting  the  Cost  of  Airplanes,”  was  published  in  the 
Journal  of  Aeronautical  Sciences  (9:9) .  In  that  article 

Wright  set  forj:h  the  now  well-known,  cumulative  average 

•  • 

cost  curve.  Consequently,  the  potential  of  the  learning 
curve  as  a  modeling  device  was  enhanced.  This  enhancement 
resulted  despite,  or  perhaps  because  of,  the  conditions 
under  which  some  of  the  data  were  collected.  For  example, 
all  of  the  1930  Boeing  data  came  from  projects  that  were 
similar.  Each  project  was  conducted  under  a  constant  work 
force  concept^  and  included  almost  identical  delivery 

^As  reported  by  Fisher  (9:29) ,  constant  work  force 
was  defined  in  January  1975  by  the  Vice  Commander  of  .Aero¬ 
nautical  Systems  Division,  Air  Force  Systems  Command,  as 
follows : 

"Constant  work  force  is  defined  as  a  concept  for  the 
development  of  a  production  schedule  which  reflects 
the  application  of  normal  learning  expectancy  in  con¬ 
junction  with  efficient  use  of  manpower  and  funding 
resources.  Its  objective  is  to  relate. manpower  build¬ 
up  to  productivity  improvement  through  'learning  and  to 
optimize  a  peak  production  rate  which  provides  for 


7 


rates.  In  sum,  all  of  the  assumptions  of  the  learning 
curve,  listed  in  Chapter  I,  were  apparently  met. 

Since  1936,  the  theory  and  application  of  learning 
curves  have  been  treated  extensively  by  the  several  lead¬ 
ing  contributors.  Some  of  the  contributors  attained  posi¬ 
tions  within  manufacturing  which  allowed  them  to  collect 
data  resulting  from  changes  such  as  accelerated  delivery 
schedules  (6:68).  For  example,  J.  R.  Crawford  was  an 
important  contributor  to  both  theory  and  application  during 
World  War  II. 

Crawford's  two  major  contributions  were: 

(1)  establishing  the  unit  cost  curve,  as  opposed  to 
Wright's  cumulative  average  cost  curve,  and  (2)  develop¬ 
ing,  or  at  least  recording,  production  scheduling  tech¬ 
niques  to  take  advantage  of  learning  curve  cost  patterns 
(6:49).  Due  to  efforts  by  Crawford  and  others,  the  abil¬ 
ity  of  the  learning  curve  models  to  account  for  improve¬ 
ments  in  manufacturing  was  reaffirmed.  Those  improvements 
were  consistent  enough  to  allow  prediction^  by  simple 
models  (12:125). 


stability  in  manpower  and  funding  resources  applica¬ 
tion  over  a  reasonable  time  period  consis  t  with 
operational  force  and  production  base  requirements." 

Spisher  (9:11-12)  had  a  thought-provoking  alter¬ 
native  way  of  stating  this  predictability,  namely  that 
once  the  standard  is  set  (e.g.,  an  80  perc'ent  learning 
curve) ,  management  will  gravitate  toward  it  through  self- 
fulfilling  prophecy. 
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Learning  Curve  Models 

Thace  art,  of  course,  at  least  two  variations  of 
the  learning  curve  model,  the  unit  curve  and  the  cumula- 
average  curve.  The  unit  learning  curve  model,  or 
Beoing  theory  (24;2D28)  can  be  expressed  as: 

Y  ■  KXb 

where: 

Y  represents  the  direct  labor  hours  for  the 
xth  particular  unit. 

K  represents  the  number  of  manhours  to  build  the 
first  unit;  • 

X  represents  the  cumulative  number  of  units 
produced;  and 

b  is  the  exponent  of  the  curve. 

The  above  expression  can  be  transformed  from  expo¬ 
nential  to  linear  form  by  extracting  the  logarithm  of  each 
term.  This  straightforward  transformation  yields  the 
following : 


Log  Y  ■  Log  R  +  b  Log  X 

In  addition  to  now  being  in  linear  form,  the  simple  model 
becomes  even  more  appealing  when  one  observes  that  as  the 
total  number  of  produced  units  doubles,  the; cost  per  unit 
decreases  by  some  constant  percentage  (24:2028). 
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The  unit  learning  curve  model,  just  presented, 
differs  from  the  cumulative  average  model  advanced  by 
T.P.  Wright  in  1936.  The  only  difference,  however,  is 
that  the  Y  (or  Y,  depending  on  notation)  represents  the 
cumulative  average  direct  labor  hours  (6:49) .  This  cumu¬ 
lative  average  model  is  also  known  in  DOD  circles  as  the 
Northrop  theory  (24;2D29). 

Both  the  unit  learning  curve  model  and  the  cumula¬ 
tive  average  learning  curve  model  are  addressed  in  this 
research.  Therefore,  at  least  two  observations  are  in 
order.  First,  learning  curve  models  ate  basically  trend 
concepts,  but  they  are  not  time  series  trends.® 

The  second  observation  is  that,  although  the  cumu¬ 
lative  average  curve  was  investigated  in  this  research,  it 
has  severe  shortcomings  as  a  general  rule  when  used  to 
project  direct  labor  costs.  (One  needs  to  keep  cost 
improvement  in  the  aggregate  distinct  from  the  individual 
item,  direct  labor  costs.)  These  shortcomings  are  due  to 
the  continual  averaging  of  the  cost  variable.  Cochran 
(6;56-59)  stated  the  shortcomings  succinctly  as  follows; 
the  cumulative  average  cost  curve  masks  the  effect  of 


®Time  series  trends  are  characterized  mainly  by 
their  observations  having  some  form  of  dependence  on  time 
(26:603-605).  Some  writers  believe  the  learning  curve 
model  is  a  time  series.  For  example,  Johnson  (13:38) 
cited  cumulative  units  as  a  factor  which  changes  systemat¬ 
ically  with  passage  of  time,  i.e.,  cumulat'ive  units  are 
proxies  for  time,  according  to  Johnson. 
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changes  In  cost,  tends  to  oveeshoot  when  used  Cor  pro¬ 
jecting  costs,  and  is  slow  to  respond  to  changes  in  costs. 

Limitations  oC  the  Learning 
(turve  Mo<iel 

Probably  due  to  its  simplicity,  intuitive  appeal, 
and  long  history,  the  learning  curve  model  is  still  widely 
used.  However,  the  learning  curve  model  does  not  taKe 
into  account  the  exogenous  changes  in  the  rate  of  produc¬ 
tion.  Those  exogenous  changes  are  a  concern  of  this 
research,  as  is  their  effect  upon  the  total  direct  labor 
requirements . 

Concern  about  exogenous  changes  in  production  rate 
is  justified  by  the  following  factors:  (1)  workers  will 
adjust  according  to  pressure  to  speed  up  or  slow  down  pro¬ 
duction;  (2)  as  more  workers  are  employed,  the  distribu¬ 
tion  of  tasks  to  each  individual  worker  should  narrow;  and 
(3)  at  higher  production  rates,  tooling  costs  and  set-up 
costs  can  be  more  widely  allocated  to  larger  numbers  of 
units  (21:44) . 

Fiscal  prudence  dictates  that  each  echelon  within 
OOD  strive  for  accurate  cost  prediction  in  order  to  bud¬ 
get,  manage,  and  control.  It  naturally  follows  that  the 
importance  of  production  rates  in  cost  estimating  must  be 
investigated  fully,  and  that  OOD  buyers  muat  consider  the 

e 

effects  of  production  rate  changes  throughout  the  acquisi¬ 
tion  process  (14:1) . 
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History  of  Efforts  to  Add  Production 
Rate  Variable 

The  crux  of  this  research  effort  rests  upon  the 
importance  of  the  production  rate  as  an  independent 
variable.  The  addition  of  this  independent  variable  to 
the  learning  curve  model  has  been  the  focus  of  several 
investigations  attempting  to  explain  the  effect  of  produc¬ 
tion  rate  changes  in  airframe  production.  Since  this  same 
basic  idea  is  to  be  tested  in  avionics  manufacturing,  the 
same  type  model  is  worthy  of  review.  Therefore,  the  deve¬ 
lopment  of  cost-estimating  models  and  the  findings  of 
several  investigators  are  reviewed.  The  majority  of  these 
individuals^  were  concerned  with  production  rates  in 
airframe  production.  Various  findings  which  tend  to  sup¬ 
port  the  importance  of  the  production  rate  variable  will 
be  discussed,  with  obvious  emphasis  on  Smith's  generalized 
model.  Some  dissenting  views  about  the  importance  of  the 
production  rate  will  then  be  discussed.  Finally,  a  sum¬ 
mary  of  the  literature  review  will  close  this  chapter. 

Colasuonno.  Colasuonno  (7:66-74)  discussed  seven 
airframe  manufacturers  whose  use  of  the  learning  curve 
model  entailed  a  cumulative  production  and  production 
rate  model  (at  least  subjectively)  in  at  least  five  of 
the  seven  cases.  Colasuonno  pointed  out: 

If  accurate  quantification  is  possible,  standardi¬ 
zation  of  the  definitions  and  categorization  of  fac¬ 
tors  involved,  as  well  as  a  systematic  method  of 
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application,  should  produce  better,  if  not  highly 
accurate  estimates  [7:75]. 

Thus,  even  as  early  as  1967  systematic  addition  of  the  pro 
duction  rate  variable  to  learning  curve  models  was  being 
considered. 

Johnson.  To  predict  labor  requirements  for  rocket 
motors,  Johnson  used  an  additive  model  as  follows: 

Y  ■  A+BXj^+CXj"^ 

where: 

Y  represents  the  direct  labor  hours  per  month 
X],  represents  the  production  rate  in  equivalent 
units  per  month 

X2  represents  the  cumulative  units  produced  as  of 
the  end  of  each  month,  and 
A,  B,  and  C  coefficients  determined  by  regression; 
Z  is  assigned  various  values  until  an  optimum 
regression  coefficient  of  determination  or 
r2  is  found  (13:30-32). 

Johnson  regressed  direct  labor  hours  by  month  as  a  linear 
function  of  production  rate  in  equivalent  units  per  month 
and  as  a  power  function  of  cumulative  units  of  production 
as  of  the  end  of  the  month  (13:30).  He  e:^ected  the  Z 
value  of  the  power  function  to  approach  the  exponent  for 
the  standard  learning  curve  model,  instead  it  was 

13 
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equivalent  to  a  20  percent  "slope^"'^  versus  the  typical 
80  percent  "slope"  (13:37).  Johnson  concluded  that  this 
lower  equivalent  "slope"  resulted  from  interaction  among 
extraneous  variables  (13:38).  Consequently,  Johnson 
reported  that  the  production  rate  was  important  in  deter¬ 
mining  the  direct  labor  requirements  in  three  of  four  sets 
of  data.  He  excluded  the  third  data  set  and  reasoned  that 
its  low  was  probably  attributable  to  deficient  methods 
in  labor  hour  accounting  procedures.  Of  the  remaining 
data  sets,  Johnson  obtained  two  good  results  and  one  fair 
result  (13:34) . 


Orsini .  Orsini  (20:S’4-80)  tested  Johnson's  rocket 
motor  model  by  using  airframe  data  from  the  C-141A  program. 
Orsini 's  procedure  employed  regression  of  Johnson's  model 
both  with  and  without  the  independent  variable  of  produc¬ 
tion  rate.  After  those  regressions  Orsini  (20:66)  tr?.ns- 
forraed  Johnson's  additive  model  into  a  multiplicative  one 
as  follows: 


Y 


^Because  the  "slope"  of  a  learning  curve  is  a  math¬ 
ematical  misnomer,  it  cannot  be  related  to  the  definition 
of  slope  in  a  straight  line.  The  "slope"  of  a  learning 
curve  is  equal  to  100  minus  the  rate  of  learning,  where 
the  rate  of  learning  is  the  constant  perctK.tage  decrease 
in  cost  per  unit  as  the  total  quantity  of  units  produced 
doubles  (19:53). 
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Y  represents  the  direct  labor  hours  per  quarter 

Xl  represents  the  nuaber  of  units  produced  per 
quarter 

X2  represents  the  cumulative  number  of  units  pro- 
duced  as  of  the  end  of  each  quarter 
B],,  and  B2  represent  regression  coefficients; 
and  e,  Is  the  base  of  natural  logarithms. 

Orsinl  drew  three  major  conclusions  from  his  stu¬ 
dies.  First/  the  production  rate  variable  contributed 
Importantly  to  the  explanatory  power  of  both  the  additive 
and  multiplicative  models.  Second,  the  multiplicative 
.model  was  a  better  predictor  than  the  additive  model 
because  the  estimate  of  the  Z  value  was  eliminated. 

Third,  Orsinl  Indicated  that  Inclusion  of  the  production 
rate  In  the  learning  curve  model  yielded  more  accurate 
results  and  would  possibly  lead  to  significant  revisions 
and  Improvement  of  cost  estimating  (20:83-36). 

Smith.  Noting  that  a  production  rate  variable  was 
not  Included  In  any  generally  accepted  model  for  esti¬ 
mating  costs  for  airframe  production,  Smith  developed  a 
model  to  Include  this  variable.  He  designed  a  model  whose 
variables  could  be  tailored  within  a  given  airframe  pro¬ 
duction  program  and  whose  coefficients  could  be  adjusted 

e 

to  accommodate  a  continually  changing  data  base  during 
production.  The  Intent  of  Smith's  efforts  was  to  provide 
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for  more  accurate  prediction  of  direct  labor  requirements 
for  additional  airframes  within  a  given  program 
(21:3,56-57) . 

For  a  model.  Smith  selected  a  modified  version  of 
Orsini's  multiplicative  model,  specifically  as  follows: 


where : 


“O  *li  ^2i 


Yi  represents  the  unit  average  direct  labor  hours 
needed  to  output  each  pound  of  airframe  in 
lot  1. 

^li  represents  the  cumulative  learning  accrued  from 
experience  on  all  airframes  of  the  same  type 
through  lot  i. 

X2i  represents  the  production  rate  of  lot  i  for  all 
airframes  of  the  same  type, 
ei  represents  the  variation  of  each  dependent 
variable  which  is  not  explained  by  the  two 
independent  variables. 

Bq,  B]_,  B2,  are  parameters  in  the  model  (21:43). 


Smith  chose  to  include  the  production  rate  in  the  multi¬ 
plicative  model  because  other  investigators  suggested  that 
its  inclusion  could  enhance  predictive  ability  of  a  model. 

e 

Moreover,  Smith  reported  that  its  inclusion  facilitated 
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aultipl*  c«9C«ssion,  and  he  Indicated  that  he  had  achieved 
good  results  from  the  model  by  using  test  data  (21:43). 

Prom  there.  Smith  linearized  the  multiplicative 
model  and  used  proxies  for  the  production  rate  variable. 
The  linearized  model  thus  became: 

Log  Yi  ■  Log  Bg+Bi  Log  Xii+B2  Log  X2i+ei 

Zn  this  form,  linear  in  each  terra,  it  became  possible  to 
use  multiple  linear  regression  (8:19). 

Smith  calculated  two  proxies  for  the  production 
rate  variable,  namely  "lot  average  manufacturing  rate"  and 
"lot  delivery  rate."  Be  defined  the  first  as  the  number 
of  airframes  in  a  lot  divided  by  the  lot  time  span,  where 
lot  time  span  was  the  time  between  release  date  from  the 
lot  for  the  first  airframe  and  the  completion  date  for  the 
last  airframe  in  the  lot.  The  second  proxy,  the  "lot 
delivery  rate,"  was  the  actual  monthly  airframe  acceptance 
rate  (21:11-13). 

Smith  employed  a  second,  or  "reduced,"  model  which 
was  merely  his  first,  or  "full"  model,  minus  the  delivery 
rate  variable.  In  other  words,  his  "reduced"  model  was  a 
unit  learning  curve  model,  as  follows: 

Xi  -  Bg-X^^®^-10*^  (21:29) 

e 

Hence,  once  both  models  were  linearized,  regression  of 
historical  data  with  each  model  allowed  Smith  to  identify 
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the  contribution  of  predictive  ability  by  the  independent 
variable  of  production  rate  (8:19). 

Smith  evaluated  data  from  the  F-4,  F-102,  and 
KC-135A  airfrhme  production  programs.  After  extensive 
investigation  (and  statistical  tests  in  a  majority  of  the 
sixteen  test  situations),  Smith  concluded  the  following: 

(1)  in  each  case,  the  production  rate  variable  was  negati¬ 
vely  correlated  with  unit  direct  labor  requirements; 

(2)  both  proxies  which  he  calculated  were  important 
contributors  to  the  full  model's  predictive  ability; 

(3)  as  evidenced  by  the  r2  values  he  obtained,  the  full 
model  more  closely  fit  the  data  than  did  the  reduced  model 
(21:142-146).  Tables  1  and  2  summarize  Smith's  regression 
analysis  and  predictive  ability  test  results. 

Conqleton  and  Kinton.  Congleton  and  Kinton  repli¬ 
cated  Smith's  study  using  data  from  T-38  and  F-5  production 
programs.  Their  methodology  was  the  same  as  Smith's,  and 
their  conclusions  largely  reaffirmed  his  findings. 

Congleton  and  Kinton  validated  the  predictive  abi¬ 
lity  of  Smith's  model,  and  their  research  was  highlighted 
by  the  following  conclusions;  (1)  there  is  a  negative 
correlation  between  production  rate  and  direct  labor 
requirements,  as  evidence  by  negative  82  coefficients  in 
each  test  situation;  (2)  the  proxies  were  .important 
contributors  to  the  predictive  ability  of  the  full  model; 
and  (3)  the  full  model  more  closely  fit  the  data  than  did 
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SUMMARY  OF  SMITH'S  REGRESSION  ANALYSIS 
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Impractical  for  test  situations 


TABLE  2 


SUMMARY  OF  SMITH'S  PREDICTIVE  ABILITY 
TEST  RESULTS 


Test 

Situation 

No. 

Percentage  Deviation® 

Full  Model 

Reduced  Model 

1 

-2.6 

14.5 

2 

2.2 

13.6 

3 

Not  Reported 

13.6 

4 

1.8 

5.3 

5 

3.1 

5.3 

6 

-7.8 

Not 

Reported 

7 

"b" 

Not 

Repotted 

8 

-0.7 

1.1 

9 

-4.2 

1.1 

10 

-1.1 

5.6 

11 

3.5 

Not 

Reported 

12 

2.2 

-3.3 

13-16 

"C" 

"c" 

These  tests  were  conducted  as  described  in  Chap¬ 
ter  IV  of  this  research  (21:56).  All  percentages  are 
rounded  to  nearest  tenth. 


Smith  reported  the  results  were  deviations 
greater  than  those  for  test  situation  6,  but  he  did  not 
report  a  value  (21:96). 

c 

Smith  reported  that  predictive  ability  tests  were 
impractical  for  situations  13  through  16  because  observa¬ 
tions  were  limited  to  seven  (21:131) . 

SOURCE:  (21:71-131). 
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th«  ctduced  model.  In  one  of  the  thirty  test  situations 
they  reported  that  (actual)  was  higher  for  the 
reduced  model  than  for  the  full  model,  but  by  less  than 
1  percent  (8:91-93). 

Other  Opinions  and  Findings 

Rarely  is  any  series  of  findings  unanimous,  and  the 
effect  of  production  rate  changes  is  no  exception.  In 
addition  to  the  teat  situation  just  mentioned,  wherein 
Congleton  and  Rinton  reported  they  arrived  at  the  higher 
actual  r2  for  the  reduced  model,  other  investigators  do 
not  agree  with  the  hypothesis  that  production  rate  changes 
are  important.  These  dissenters  include  at  least  four 
investigators . 

Asher.  Asher  (1:36-87)  evaluated  empirical  data 
for  various  airframe  production  programs.  Rather  than 
attempt  to  statistically  segregate  the  effect  of  pro¬ 
duction  rate  and  the  effect  of  cumulative  production  on 
unit  costs,  he  subjectively  evaluated  the  effect  of  the 
production  rate  on  direct  labor  hours.  Asher  noted  there 
were  two  ways  that  the  rate  of  production  could  influence 
unit  labor  cost.  It  could  affect  the  machine  set-up  time, 
that  is  the  number  of  hours  charged  to  each  unit  of  pro¬ 
duction.  And  it  could,  according  to  Asher,,  affect  the 
number  of  subassemblies  in  a  manufacturing  process  which, 
in  turn,  could  lead  to  an  effect  on  the  number  of  hours  of 


subassembly  work  charged  to  a  unit.  Asher  concluded  that 
production  rate  was  not  very  important  when  compared  to 
the  effect  of  cumulative  production.  He  also  concluded 
that  aside  from  set-up  time  and  subassemblies,  there  was 
little  reason  to  expect  a  significant  difference  in  unit 
hours  per  month,  whether  200  or  30  units  per  month  was 
the  manufacturing  rate. 


Large,  Hoffmayer,  and  Kontrovich.  These  three 
investigators  evaluated  cost  for  major  defense  buys  of 
airframes  at  varying  production  rates  during  an  effort  to 
develop  a  general  cost  model  which,  according  to  Smith 
(12:30),  was  of  the  form: 


■  A*w®»s^*r^ 


where : 

Yi  represented  the  cumulative  direct  manufacturing 
labor  hours  through  unit  i 
w  represented  the  program  average  OCPR  weight® 


®It  is  the  practice  of  the  government  to  furnish 
many  components  to  a  contractor  building  a  new  aircraft. 
Engines,  electronic  systems,  wheels,  brakes,  tires,  and 
batteries  exemplify  these  types  of  components.  To  have  a 
common  basis  for  comparing  weight  based  on  cost  estimating 
relationships,  government  and  industry  have  agreed  to  a 
Defense  Contractor  Planning  Report  (DCPR)  weight  that 
excludes  the  government-furnished  equipment,  fuels  and 
lubricants.  The  DCPR  weight  was  formerly  .termed  the  Air¬ 
frame  Manufacturer  Planning  Report  (AMPR)  weight  (21:11- 
12)  . 


s  represented  the  fflaximuio  design  airspeed  in 
knots 

r  represented  the  production  rate  expressed  as  the 
acceptance  span  in  months  for  the  first  i 
airframes  (NOTE:  ?or  their  investigation, 
Z,arge,  Hoffmayer,  and  Rontrovich  chose  i  at  an 
arbitrary  100  or  200) . 

k,  B,  C,  and  D  were  model  parameters. 

Large,  Hoffmayer  and  Kontrovich  concluded  that  the 
effect  of  production  rate  change  could  not  be  confidently 
predicted  based  on  their  findings  and  analysis  (14:50-51). 
Smith  (21:30-31)  commented  that  their  use  of  an  acceptance 
span  for  production  rate  almost  of  necessity  obscured  the 
effect  of  production  rate  change. 

Large,  Hoffmayer,  and  Kontrovich  also  investigated 
the  Johnson  rocket  motor  model.  Their  results  were  dif¬ 
ferent  than  Orsini's.  They  concluded  that: 

In  none  of  the  programs  did  the  inclusion  of  pro¬ 
duction  rate  improve  the  coefficient  of  determination, 
r2,  by  as  much  as  one  percent  over  what  was  obtained 
using  cumulative  quantity  alone  [14:49]. 

Hirsch.  Orsini  (20:53)  reported  that  Werner  Z. 
Hirsch  did  not  include  production  rate  in  his  study  of 
empirical  data  in  machine-tool  manufacturing  because  he 
believed  changes  in  production  rate  were  a'jLready  accounted 
for  in  cumulative  output. 
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Summary 


Almost  all  of  the  literature  reviewed  contained  an 
interest  in  the  relationships  between  production  rate  and 
direct  labor  requirements.  The  controversy  which  clearly 
shows  up  is  whether  or  not  there  is  a  significant  rela¬ 
tionship  between  production  rate  and  direct  labor  require¬ 
ments.  A  dominant  theme  of  the  literature,  dissensions 
noted,  was  that  production  rate  is  an  important  contribu¬ 
tor  to  the  predictive  ability  of  a  learning  curve  model. 
This  research, therefore ,  is  aimed  at  two  particular  areas: 

1.  Is  there  a  significant  relationship  in  avionics 
production  between  production  rate  and  direct  labor 
requirements,  and 

2.  Is  production  rate  in  avionics  production  an 
important  contributor  to  the  predictive  ability  of  a 
learning  curve  model? 

The  next  chapter  outlines  the  methodology  to  be  used  to 
answer  these  questions. 


CHAPTER  III 


RESEARCH  METHODOLOGY 

This  chapter  outlines  the  research  hypotheses  and 
the  methodology  used  to  test  them.  The  chapter  is  divided 
into  six  sections  as  follows: 

1.  Objectives  and  approach; 

2.  The  variables; 

3.  Model  definitions  and  assumptions; 

4.  Research  hypotheses; 

5.  Data  collection  and  treatment;  and 

6.  Summary. 

Objectives  and  Approach 

The  objectives  of  this  research  were:  (1)  to 
determine  if  there  was  an  effect  by  production  rate 
changes  on  production  direct  labor  requirements  for 
avionics  production,  and  (2)  to  evaluate  the  predictive 
ability  of  the  cumulative  production  and  production  rate 
model  for  eighteen  months  into  the  future.  In  meeting 
these  objectives,  additional  information  relevant  to  the 
scope  and  applicability  of  the  cumulative  production  and 
production  rate  model  was  revealed. 

The  approach  was  to  collect  historical  production 

data  from  avionics  manufacturing  and  evaluate  those  data 

via  replication  of  Smith's  model,  previously  described 
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in  Chapttc  IZ.  As  in  Smith's  cssearch,  as  wall  as  in 
Conglaton  and  Rinton's,  tha  objective  was  not  to  formulate 
a  generalized  cost  model.  Rather,  the  intent  of  the 
research  was  to  evaluate  the  avionics  production  data  as  a 
means  of  adjusting  an  appropriate  form  of  the  cumulative 
production  and  production  rate  model  to  specified  programs 
outside  airframe  manufacturing.  Thus,  the  value  of  a 
properly  adjusted  model,  when  compared  with  the  learning 
curve  model,  lies  in  its  potential  ability  to  predict  more 
accurately  the  direct  labor  requirements  in  avionics  pro¬ 
duction. 

The  Variables 

Three  avionics  production  variables  and  their  rela¬ 
tionships  were  evaluated.  The  variables  were  continuous 
and  identified  as  follows: 

1.  The  direct  labor  hours  variable. 

2.  The  cumulative  output  variable. 

3.  The  production  rate  variable. 

Although  any  one  of  the  variables  could  be  con¬ 
sidered  dependent  on  the  other  two,  direct  labor  hours 
was  designated  the  dependent  variable. 

The  Direct  Labor 
kours  Variable 

Expressed  as  direct  labor  hours,  th*e  dependent 
variable  comes  primarily  from  assembly,  fabrication,  and 
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testing.  It  also  included  hours  devoted  to  preventive 
maintenance,  inspection,  quality  assurance,  material 
handling,  repairing,  troubleshooting,  and  packing.  All  of 
the  hours  of  the  dependent  variable  pertained  to  in-house 
operations . 

The  Cumulative  Output  Variable 

Cumulative  output  in  this  research  was  the  cumula¬ 
tive  number  of  equivalent  units  of  production  as  of  the 
end  of  an  accounting  month. 

The  Production  Rate  Variable 

The  production  rate  variable  in  its  basic  form  was 
the  number  of  equivalent  units^  produced  during  an 
accounting  month. 

Model  Definition  and  Assumptions 
Two  types  of  models  were  investigated  during  analy¬ 
sis  of  each  model,  one  through  five.  The  first  type  of 
model,  the  learning  curve  model,  hereafter  is  referred  to 
as  the  reduced  model.  The  second  type  of  model,  the  cumu¬ 
lative  production  and  production  rate  model,  hereafter  is 
referred  to  as  the  full  model.  Both  types  of  models  were 

^An  equivalent  unit  is  a  common  denominator  which 
represents  the  total  work  of  a  department  or  process  in 
terms  of  full  completed  units.  As  the  ASPM  No.  1 
(24:2031)  indicates,  for  continuous  process  production  the 
costs  are  usually  attributed  to  equivalent,  not  actual 
units.  Related  discussions  are  found  in  Cochran  (6:435- 
437)  and  Johnson  (13:34). 


investigated  by  Smith  (21:42-43).  Both  the  reduced  and 
full  models  were  evaluated  by  Congleton  and  Kinton 
(8:31-32).  Finally,  a  discussion  of  each  type  of  model  is 
found  in  Neter  and  Wasserman  (17:256-258). 


Common  terms  in  each  type  of  model  have  the  same  meaning 
and  are  described  as  follows: 


Yi  represents  the  direct  labor  hours  variable; 

X],  represents  the  cumulative  output  variable; 

X2  represents  the  production  rate  variable;  and 
e^  represents  the  variation  in  each  dependent 

variable  value  that  is  not  explained  by  the  two 
independent  variables;  finally 
Bg,  B],,  and  B2  are  model  parameters. 

The  notation  and  precise  definitions  of  each  model  and  its 
variables  will  be  described  and  summarized*  in  tabular  form 
near  the  end  of  this  chapter. 


28 


Assumptions  of  the  Models 

The  first  assumption  of  the  models  concerns  the 
potential  loss  of  precision  in  the  data,  to  be  explained 
shortly.  To  facilitate  multiple  linear  regression,  the 
method  used  to  investigate  each  model,  terms  of  the  models 
were  linearized  (17:123-128)  by  taking  the  common 
logarithm  of  each  term. 

In  log-linear  form  then,  the  reduced  models  become: 

Log  Yi  ■  Log  Bq  +  Bj.  Log  +  ei 
and  the  full  models  become: 

I 

Log  Yj_  ■  Log  Bg  +  B]_  Log  +  B2  Log  X2  +  e^ 

It  is  pointed  out  that  such  a  transformation  to 
logarithmic  form  does  affect  the  least  squares  estimators. 
According  to  Neter  and  Wasserman  (17:130): 

When  transformed  models  are  employed,  the  esti¬ 
mators  bg  and  b^  obtained  by  least  squares,  have  the 
least  squares  properties  with  respect  to  the  trans¬ 
formed  observations,  not  the  original  ones. 

The  assumption  was  made,  therefore,  that  transformation 

did  not  introduce  a  significant  loss  in  the  precision  of 

the  data. 

A  second  assumption,  or  set  of  assumptions,  related 
to  the  error  terms.  To  allow  for  statistical  significance 
testing  of  the  regression  results,  the  error  terms  (ei)  in 
the  logarithmic  domain  were  assumed  to  be  normally  distri¬ 
buted  with  a  mean  of  zero  and  a  constant  variance. 


Moreover,  the  error  terms  were  assumed  to  be  independent 
of  each  other  and  of  the  Independent  variables  (17:30-31). 

It  is  emphasized  that  as  a  practical  matter,  one 
should  not  be  unduly  concerned  with  normality  of  the  error 
terms.  That  is  not  to  be  construed  as  a  rationalization 
for  a  model  not  fitting  a  data  set;  rather,  in  this 
research  the  prime  objective  of  the  model,  its  predictive 
ability,  was  borne  in  mind  as  the  residuals  were  subjec¬ 
tively  evaluated.  In  their  statistical  text,  Meter  and 
Wasserman  (17:48)  stated  that: 

.  .  .  unless  the  departures  fro;;  normality  are 
serious,  particularly  with  respect'to  skewness,  the 
actual  confidence  coefficients  and  risks  of  error  will 
be  close  to  the  levels  for  exact  normality. 

The  third  assumption  of  the  model,  to  be  discussed 
momentarily,  stemmed  from  a  complication  of  regression  ana¬ 
lysis.  The  complication  which  did  occur  in  this  research 
was  multicollinearity^*^  between  the  two  independent  vari¬ 
ables.  The  likelihood  for  this  was  evidenced  by  viewing 
the  learning  curve  theory  in  reverse.  That  is  to  say,  if 
labor  hours  are  held  constant  while  cumulative  output 
increases,  the  rate  of  production  goes  up  because  each 
successive  item  requires  less  production  time  (8:33)  . 
Moreover,  the  likelihood  of  multicollinearity  was  evi¬ 
denced  initially  by  the  very  nature  of  the  data  (17:255). 

e 

^^Multicollinearity  is  treated  separately  in  Appen¬ 
dix  a. 
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In  regression  analysis,  high  multicollinear ity 
between  or  among  independent  variables  may  cause  the  indi 
vidual  regression  coefficients  to  vary  widely  among 
samples.  A  possible  consequence  is  rejection  of  the 
significance  of  a  coefficient  when,  in  fact,  the  coef¬ 
ficient  is  significant  (17:341).  Despite  this  possible 
consequence,  the  predictive  ability  of  the  model  in  the 
short  range  may  not  be  importantly  Impaired.  Because  the 
model's  biggest  asset  was  its  predictive  ability  in  this 
research,  the  model  was  still  of  value,  as  evidenced  by 
both  statistical  and  criterion  tests.  The  production 
rate  as  an  added  explainer  of  variation  in  the  dependent 
variable  was  subjectively  evaluated  by  comparing  the  pre¬ 
dicted  values  of  direct  labor  hours  made  by  both  the  full 
and  reduced  models  with  observed  values  (3:33).  In  sum, 
the  third  assumption  of  the  models  was  that  the  varying 
degrees  of  multicollinear ity  did  not  importantly  impair 
their  short-range  predictive  abilities. 


Research  Hypotheses 


This  research  tested  two  hypotheses.  The  first  hypoth 
esis  was  that  the  production  rate  was  an  important 
explainer  of  variation  in  direct  labor  requirements  for 
avionics  production  when  included  in  an  appropriate  model 
The  second  hypothesis  was  that  for  eighteejn  months  into 
the  future  the  predictive  ability  of  the  full  model  was 
better  than  the  predictive  ability  of  the  reduced  model. 
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R«««arch  Hypoth»si8  One 

Th«  first  ressacch  hypothesis  was  tested  in  two 
steps.  The  first  step  was  examination  for  statistical 
significance  of  the  model's  regression  coefficients  deter¬ 
mined  by  regression  analysis  of  historical  avionics  pro¬ 
duction  data.  The  second  step  was  use  of  two  criterion 
tests  to  evaluate  the  appropriateness  of  the  model  for  the 
data.  The  model  tested  was  the  full  model  in  log-linear 
form.  During  those  tests,  the  dependent  variable  was  sub¬ 
jected  to  regression  analysis.  The  independent  variables 
in  turn  for  and  the  common  logarithms  of  the 

cumulative  output  and  production  rate  variables. 

Statistical  Hypothesis  One  (A) 

Statistical  Hypothesis  One  (A)  (8:3S)  stated  that 
the  cumulative  output  variable  and  the  production  rate 
variable  were  related  to  labor  hours  as  indicatd  in  the 
model.  Putting  the  null  hypothesis  and  its  alternate  in 
statistical  form  yielded  the  following: 

Hg :  3^  and  82  *  0 

Hj;  Bi  ^  0  and/or  82  0 

The  decision  rule  was  as  follows:  The  null 

e 

hypothesis  was  rejected  if  the  test  statis'tic  F^atio  was 


greater  than  the  critical  statistic^^  Fc  at  the  0.05  level 
of  significance. 

For  this  statistical  test,  F  Ratio  ■  MSR/MSE 
(MSR  ■  SSR/(p-l);  MSE  ■  SSE/(n-p)]  where,  in  logarithmic 
form: 

MSR  represents  the  mean  of  the  regression  sum  of 
squares; 

.MSE  represents  the  mean  of  the  error  (or  residual) 
sum  of  squares; 

SSR  represents  the  regression  sum  of  squares; 

SSE  represents  the  error  (or  residual)  sum  of 
squares;  and 

n  represents  the  number  of  observations, 
p  represents  the  number  of  parameters  in  the 
model 

In  sum,  the  F  Ratio  compares  the  explained  variance  (MSR) 
with  the  unexplained  variance  (MSE) ,  and  it  indicates  the 
relationship  between  direct  labor  hours  and  the  set  of  two 
independent  variables,  cumulative  output  and  production 
rate  (17:45,79,227-228). 

Statistical  Hypothesis  One  (3) 

Statistical  Hypothesis  One  (B)  (8:36)  was  designed 

to  test  ability  of  the  production  rate  variable,  when  com¬ 
bined  with  the  cumulative  output  variable,*  to  explain 

^^Fc  values  were  extracted  from  Meter  and  Wasser- 
man's  F-distr ibution  tables  (17 : 30‘’-813)  . 


additional  variation  in  the  direct  labor  hours.  Statis¬ 


tically  speaking,  the  82  coefficient  was  hypothesized  to 
be  nonzero  at  the  Q.QS  level  of  significance.  In  null  and 
alternate  foras,  statistical  hypthesis  one  (B)  was  as 
follows: 

Hq:  82  ■  0 
Ha:  32  0 

As  earlier,  the  null  hypothesis  was  rejected  if  the  test 
statistic  F*  was  greater  than  the  critical  statistic  at 
the  0.05  level  of  significance. 

For  this  test,  the  T*  was  calculated  by  determining 
the  increase  in  explained  variation  of  the  dependent 
variable  that  was  attributed  to  the  Introduction  of  the 
logarithm  of  the  production  rate  variable  into  the  reduced 
model.  In  specific  terms: 


where: 


F* 


R _ 

{l-R2)/(n-k-l) 


r2  represents  the  change  in  the  explained 
variation; 

n  represents  the  number  of  observations; 
k  represents  the  total  number  of  regressors; 
and 

e 

n-k-1  represents  the  degrees  of  freedom  in  the 
unexplained  variation  (26:435) 


34 


L 


Because  the  two  independent  variables  in  this 
research  were  correlated,  an  observation  is  in  order.  It 
is  noted  that,  while  the  increase  in  explained  variation 
of  the  dependent  variable  can  be  attributed  to  the  intro¬ 
duction  of  the  logarithm  of  the  production  rate  variable, 
not  all  of  that  increased  explained  variation  is  uniquely 
attributable  to  the  additional  variable.  Rather,  the 
incremental  change  in  explained  variation  of  the  dependent 
variable  is  that  variation  associated  with  the  introduction 
of  the  logarithm  of  the  production  rate  variable,  given 
that  the  logarithm  of  the  cumulative  output  variable  is 
already  included  in  the  model  (17:253). 

The  crux  of  the  dilemma  concerning  partitioning 
incremental  changes  in  variation  when  the  independent 
variables  are  correlated  was  described  by  Neter  and 
Wasserman  (17:253)  as  follows: 

When  independent  variables  are  correlated,  there  is 
no  unique  sum  of  squares  which  can  be  ascribed  to  an 
independent  variable  as  reflecting  its  effect  in 
reducing  the  total  variation  in  Y. 


Criterion  Test  One  (A) 

Whereas  Smith  (21:50-52)  used  a  subhypothesis  to 
evaluate  the  appropriateness  of  the  model,  Congleton  and 
Kinton  (8:37-39)  used  a  criterion  test.  Both  methods 
yield  the  same  objective  in  determining  the  appropriate¬ 
ness  of  the  model.  Because  determination *of  the 
appropriateness  of  the  model  was  necessarily  partially 


subjective,  two  criterion  tests  were  used  in  this 
research.  The  model  was  not  rejected  as  inappropriate  if 
the  first  criterion  test,  to  be  described  momentarily, 
revealed  an  inability  to  reject  assumptions  about  the  nor¬ 
mal  distribution  of  the  residuals,  their  independence,  and 
their  constant  variance  (17:240). 

Whether  the  residuals  are  normally  distributed  may 
be  checked  in  at  least  two  ways.  They  may  be  plotted  on 
normal  probability  paper  to  determine  if  they  deviate 
substantially  from  a  straight  line.  Or  the  residuals  can 
be  classified  into  a  histogram  (17:107).  Because  the 
plot  on  normal  probability  paper  was  faster,  that  method 
was  used  in  this  research.  When  the  deviations  from  a 
straight  line  were  not  substantial,  that  is,  when  the 
departures  were  not  serious,  as  noted  by  Neter  and 
Wasserman,  the  assumption  of  normality  was  not  rejected. 

Meter  and  Wasserman  (17:105,240)  discussed  inde¬ 
pendence  of  residuals  in  the  following  way.  To  determine 
if  the  residuals  are  independent  of  each  other  and  of  the 
independent  variable,  they  can  be  plotted  against  each 
independent  variable  to  test  for  cyclic  recurrences  or 
trends.  If  there  are  no  such  recurrences  or  trends  and  if 
the  residuals  fluctuate  randomly  above  and  below  the  line 
formed  by  the  plot  of  the  predicted  values,  the  assump- 
tions  of  independence  will  be  considered  m*et.  In  this 
research,  that  method  of  checking  independence  was  used. 
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The  absence  of  recurrences,  trends,  and  patterns  was  the 
criterion  used  for  ability  or  inability  to  reject  the 
assumption  of  independence  of  residuals. 

Acceptability  of  the  assumption  of  constant 
variance  of  residuals  was  evaluated  by  plotting  the  resi¬ 
duals  against  the  value  of  the  dependent  variables  pre¬ 
dicted  by  regression.  If  the  plot  revealed  an  even 
distribution  and  if  a  heavy  majority  of  the  residuals  were 
within  one  standard  error  of  the  estimate,  the  assumption 
of  constant  residual  variance  was  considered  met  (17:102- 
103). 

In  sum,  the  evaluation  of  the  residuals  was  impor¬ 
tant  when  the  appropriateness  of  the  model  was  being  eval¬ 
uated.  Such  an  evaluation,  in  fact,  was  a  prerequisite 
for  determining  the  model  to  be  either  appropriate  or 
inappropriate  for  a  data  base  (17:43).  The  appropriate¬ 
ness  of  the  model  could  not  be  rejected  if  an  analysis  of 
the  residuals  reflected  the  properties  of  constant  vari¬ 
ance,  independence,  and  normality  assumed  for  the  theo¬ 
retical  residuals. 

Criterion  Test  One  (B) 

A  second  criterion  test  (21:52-54)  used  to  evaluate 
the  appropriateness  of  the  model  was  the  test  of  the  mul¬ 
tiple  coefficient  of  determination,  commonly  termed 
(17:228).  The  measures  the  proportion  of  variation  in 
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th«  d«p«ndcnt  variable  explained  by  the  regression  model. 
Put  another  way,  Is  equal  to  one  minus  the  quotient  of 
SSE/SSTO  (17:228).  The  error  sum  of  squares,  SSE,  was 
just  defined  under  statistical  hypothesis  one  (A).  More 
specifically,  SSE  is  the  summation  of  all  squared  resid¬ 
uals  (17:77).  The  SSTO  is  the  total  sum  of  squares  and  is 
equal  to  the  summation  of  the  squared  differences  between 
each  observed  value  and  the  mean  of  the  dependent  variable 
(17:77)  . 

The  distinction  of  in  the  models  of  this 
research  was  that,  due  to  transformation  of  the  rational 
values  to  logarithms  prior  to  regression  analysis,  the  R^ 
was  really  the  proportion  of  explained  variation  to  total 
variation  in  the  logarithms  of  labor  hours,  not  labor  hours 
per  se.  To  make  R^  more  meaningful  in  terms  of  actual 
labor  hours.  Smith  (17: 5J)  developed  a  second  statistic  for 
use  in  his  research.  This  second  statistic,  termed  R^ 
(actual)  was  computed  by  a  procedure  analogous  to  the  one 
just  described.  The  only  difference  was  that  for  the 
r2  (actual)  the  SSE  and  SSTO  computations  were  in  terms  of 
observed  labor  hours. 

The  calculations  of  variation  in  observed  labor 
hours  was  made  possible  because  the  predictions  in 
logarithms  were  transformed  to  labor  hours  in  rational 

e 
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numbers,  the  form  of  the  original  variable.  These  trans¬ 
formations  were  included,  of  course,  as  integral  parts  of 


the  computer  program  located  and  described  in  Appendix  A. 
And  as  earlier  stated,  it  was  assumed  that  such  transfor¬ 
mations  did  not  involve  a  significant  loss  in  the  preci¬ 
sion  of  the  data. 

Because  r2  (actual)  measured  the  proportion  of 
variation  in  labor  hours  explained  by  the  regression 
model,  a  high  (actual)  was  a  practical  consideration 
in  determining  which  models  were  in  fact  appropriate. 
Accordingly,  the  criterion  test  chosen  for  R^  (actual)  in 
this  research  was  as  follows.  If  the  regression  results 
of  the  model  included  an  r2  and  an  r2  (actual)  e.xpeeding 

85  percent,  the  model  could  not  be  rejected  as  inappro¬ 
priate.  If  the  model  could  not  be  rejected,  the  predic¬ 
tive  ability  was  then  tested  under  Research  Hypothesis 

Two. 


Research  Hypothesis  Two 

The  second  research  hypothesis  was  that  for 
eighteen  months  into  the  future  the  predictive  ability  of 
the  full  model  was  better  than  the  predictive  ability  of 
the  reduced  model.  As  in  research  hypothesis  one,  this 
second  research  hypothesis  was  evaluated  using  both  a  sta¬ 
tistical  hypothesis  to  test  statistical  significance,  and 
a  criterion  test  for  practical  significance. 

The  statistical  test  used  in  this  portion  of  the 
research  was  a  simple  Z  test  of  the  differences  between 
two  means.  To  conduct  this  test,  future  predictive 
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Ability  was  simulated  using  a  stepwise 
tocical  data.  Smith  (21:56)  described 
lows: 


truncation  of  his- 
the  process  as  Col¬ 


in  a  real  application  of  the  model,  the  prediction 
would  be  beyond  the  range  oC  the  historical  data.  The 
only  way  to  test  the  accuracy  oC  the  prediction  would 
be  to  wait  ‘nd  see  how  many  hours  it  takes  to  build  the 
next  airframe  lot.  To  simulate  this  situation,  the 
regression  coefficients  in  the  model  are  estimated  with 
the  last  few  observed  data  points  omitted.  Then  using 
the  new  model,  chitted  values  (which  are  known  but  not 
used  in  estimating  the  model  coefficients)  are  pre¬ 
dicted.  Coi'f'arisons  are  then  drawn  between  the  actual 
and  predicted  hours  as  a  subjective  measure  of  predic¬ 
tive  ability. 


Statistical  Hypothesis  Two 

To  perform  a  teat  Cor  statistical  significance  it 
was  necessary  to  formalize  the  subjective  comparisons  of 
actual  and  predicted  direct  labor  hours  into  an  objective 
measure  of  difference.  This  was  done  by  taking  the  abso¬ 
lute  value  of  the  difference  between  the  actual  and  pre¬ 
dicted  direct  labor  hours  occurring  with  the  full  and 
reduced  models  in  each  test  situation.  These  absolute 
deviations  were  then  separately  summed  for  each  model  in 
all  test  situations.  The  mean  and  variance  of  the  two 
distributions  of  absolute  deviations  were  then  calculated. 
A  statistical  comparison  of  the  two  distributions  was  then 
possible  to  test  the  hypothesis  that  the  predictive  abi¬ 
lity  of  the  full  model  was  better  than  the  predictive  abi- 

e 

e 

lity  of  the  reduced  model.  This  hypothesis  could  be 
stated  more  precisely  as:  The  average  absolute  deviation 
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of  the  full  model  ( iDpi  )  is  significantly  less  than  the 
average  absolute  deviation  of  the  reduced  model  { |6r|  ) . 
Thus,  in  null  and  alternate  forms,  statistical  hypothesis 
two  becomes ; 


Ho!  IPrI  ^  iSpI 
Hg:  >  iPpI 

The  decision  rule  using  the  2  statistic  (17:12-17) 
becomes : 

Reject  Hq  if  2  >  2c  (.05) 

where 

2  -  IDrI  -  !5pl/  ^(Sj^^/N)  +  (Sp^ 'N) 

and 

2 

Sj^  ■  variance  of  the  distribution  of  deviations 
obtained  with  the  reduced  model; 

2 

Sp  ■  variance  of  the  distribution  of  deviations 
obtained  with  the  full  model; 

N  ■  the  number  of  test  situations;  and 
Zc  ■  critical  2  value  obtained  from  a  table  of 
critical  values  for  the  standard  normal 

distribution. ^2 

e 

^^2c  values  for  the  one-tailed  test  were  extracted 
from  Meter  and  Wassecman's  standard  normal  distribution 
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Th«  Z  statistic  used  hart  csftrs  to  the  use  of  the 
standard  normal  distribution.  The  Student's  t  distribu¬ 
tion  should  be  used  in  situations  where  the  number  of  test 
situations  was  small  (less  than  60) .  In  this  research, 
however,  the  number  of  test  situations  was  anticipated  to 
be  sufficiently  large  to  permit  the  use  of  the  standard 
normal  statistic.  In  applying  either  a  Z  or  t  test,  the 
assumptions  were  made  that  the  deviations  were  normally 
distributed  and  random.  ,  Since  these  assumptions  were  also 
made  in  computation  of  the  regression  statistics  in 
research  hypothesis  one,  the  authors  believe  the  assump¬ 
tions  were  compatible. 

In  evaluating  the  predictive  ability  of  the  full 
and  reduced  models,  statistical  significance  alone  does 
not  indicate  the  value  of  the  model.  For  example,  if  the 
full  model  overestimated  the  direct  labor  requirements  on 
the  average  by  100  percent  and  the  reduced  model  overesti¬ 
mated  the  same  direct  labor  requirements  on  the  average  by 
ISO  percent,  this  difference  in  the  two  means  could  easily 
be  proved  to  be  statistically  significant.  However, 
neither  model  would  be  of  any  practical  value  in  esti¬ 
mating  costs.  Accordingly,  a  criterion  test  was  developed 

table.  Table  A-1  (17:803).  A  5  percent  level  of  signifi¬ 
cance  for  the  Zq  was  chosen  because  of  the  prevalent  use 
of  the  95  percent  confidence  interval  in  dhe  statistical 
and  research  literature  reviewed.  In  practice,  of  course, 
the  user  would  want  to  choose  a  level  of  significance  con¬ 
sistent  with  the  risic  he  would  be  willing  to  take. 
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to  address  this  practical  aspect  of  the  importance  in  the 
predictive  ability  of  the  full  and  reduced  models. 

Criterion  Test  Two 

To  perform  the  criterion  test,  the  individual 
deviations  computed  for  the  full  and  reduced  models  in 
each  test  situation  under  statistical  hypothesis  two  were 
converted  into  a  measure  of  deviation  expressed  as  a 
percentage  of  the  actual  direct  labor  hours.  The  authors 
believed  that  the  use  of  percentages  in  this  test  would 
facilitate  comparison  of  results  between  programs  whose 
values  for  direct  labor  hours  were  relatively  small  (e.g., 
hundreds  of  hours)  and  programs  whose  values  for  direct 
labor  hours  were  relatively  large  (e.g.,  thousands  of 
hours) .  Two  arbitrary  categories  were  then  established 
for  the  deviations. 

These  categories  provided  a  basis  for  comparison  of 
the  predictive  ability  of  the  two  models.  When  the  per¬ 
centage  deviations  were  limited  to  10  percent  or  less,  the 
predictive  ability  was  categorized  as  good;  and  when 
the  percentage  deviations  were  limited  to  5  percent  or 
less,  the  predictive  ability  was  categorized  as  excel¬ 
lent,  The  number  of  test  situations  in  which  the  percent¬ 
age  deviations  fell  into  these  categories  was  then  sepa¬ 
rately  summed  for  the  full  and  reduced  models.  Totals  for 
each  category  and  model  were  then  subjectively  compared 
and  the  model  with  the  greater  total  number  of  good  and 
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excellent  peedictlone  was  judged  to  have  the.  better  prac¬ 
tical  predictive  ability. 

This  criterion  test,  while  very  simple,  permitted  a 
comparison  oC  how  well  each  model  could  predict  the 
future. 


Data  Collection  and  Treatment 
Because  the  approach  of  this  research  was  to 
replicate  Smith's  full  model  and  extend  it  to  production 
data  outside  airframe  manufacturing,  accessiblity  was  the 
primary  factor  in  selecting  data.  The  data  were  histori¬ 
cal  and  represented  two  individual  avionics  production 
programs.  Both  programs  were  already  established  and 
ongoing.  One  data  set  contained  thirty-nine  data  points; 
the  other,  forty-seven.  All  data  were  provided  directly 
by  the  manufacturer  under  the  following  labels:  (1)  num¬ 
ber  of  workdays  per  accounting  month;  (2)  equivalent  units 
of  production  per  accounting  month;  and  (3)  average  direct 
labor  hours  per  equivalent  unit  per  accounting  month. 
Treatment  of  the  data  for  the  dependent  variable  and  for 
the  independent  variables  was  necessary  to  tailor  the  data 
to  the  models. 

Treatment  for  Labor  Hours 

Data  for  labor  hours  were  provided  as  the  average 

« 

e 

direct  labor  hours  per  equivalent  unit  per  accounting 
month.  The  following  breakout  was  used  in  this  research. 
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1.  Yu  stands  for  the  unit  cost  dependent 
variable.  Where  Y^  is  used/  the  dependent  variable  repre¬ 
sents  the  average  direct  labor  hours  per  equivalent  unit 
per  accounting  month,  as  provided  by  the  manufacturer. 

2.  Yc  stands  for  the  cumulative  average  cost 
dependent  variable.  Where  Y^^  is  used,  the  dependent 
variable  represents  the  cumulative  average  direct  labor 
hours  per  equivalent  unit.  This  distinction  between 

Yy  and  Yc  was  noted  by  Smith  (21:9)  as  a  common  one, 
although  his  investigations  centered  on  the  unit  cost 
dependent  variable.  To  derive  Y^  requires  two  steps, 
given  the  data  as  provided  by  the  manufacturer.  First, 
the  equivalent  units  produced  during  an  accounting  month 
are  multiplied  by  the  average  direct  labor  hours  per 
equivalent  unit  per  accounting  month.  Second,  the 
resulting  product  is  then  divided  by  the  number  of  cumula¬ 
tive  units  to  date. 

3.  Yt  stands  for  the  total  cost  dependent  vari¬ 
able.  Where  Y^  is  used,  the  dependent  variable  represents 
the  total  direct  labor  hours  per  accounting  month,  as  used 
by  Johnson  (13:37).  Y^  is  derived  simply  by  taking  the 
product  of  equivalent  units  per  accounting  month  and 
average  direct  labor  hours  per  equivalent  unit  per 
accounting  month. 


Tr«*ta€nt  for  Cumulative 
Output  (Lot  Plotpoints)"* 

Foe  4ll  mod«ls  «iaploylng  the  avecaqe  hours  pec 
equivalent  unit  per  accounting  month  variable  (Y^)  as  the 
dependent  variable,  the  cumulative  units  produced,  X]^,  had 
to  be  adjusted  to  avoid  incorrect  conclusions  about  the 
relationship  between  cost  and  quantity  (3:7-8).  This 
necessary  adjustment  makes  both  practical  and  intuitive 
sense  for  at  least  two  reasons.  First,  unlike  a  cum¬ 
ulative  average  cost  curve  which  by  definition  is 
smoothed,  the  unit  cost  curve  falls  extremely  fast  from 
its  initial  point  for  unit  one.  Second,  the  whole  idea 
behind  establishing  a  correct  plotpoint  is  to  approximate 
the  learning  curve  applicable  to  production  in  a  given  lot 
(6:112) . 

Accordingly,  the  Xx  variable,  cumulative  output, 
was  adjusted  in  three  steps  where  appropriate,  as  follows: 

1.  Midpoints  for  each  of  the  lots  (or  each 
accounting  month's  number  of  equivalent  units  produced,  as 
provided  by  the  manufacturer)  were  calculated,  using  the 
first  and  last  units  of  each  lot,  summing  them  and 
dividing  the  result  by  two  to  arrive  at  a  midpoint  for 
that  Lot  (6:111). 

2.  All  midpoints  derived  in  step  one  were  then 
entered  into  the  data  base  in  place  of  the  original  X^ 
Independent  variables,  as  provided  by  the  manufacturer. 
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The  data  were  then  regressed  and  a  learning  curve  "slope" 
obtained. 

3.  Finally,  in  accordance  with  established 
learning  curve  technique  (21:61),  the  midpoint  for  the 
first  lot  was  replaced  with  the  tablular  value  (3)  which 
corresponded  to  the  size  of  the  first  lot  within  the  table 
provided  for  the  "slope"  obtained  from  the  regression  in 
step  two. 

For  the  second  and  succeeding  lots,  the  plotpoints 
were  simply  actual  midpoints  (6:122).  After  treatment  to 
this  point,  then,  all  plotpoints  conformed  conceptually  to 
the  lot  cost  average.  This  conformance  was  the  objective, 
to  avoid  incorrect  conclusions  about  the  relationship  bet¬ 
ween  cost  and  quantity  (3:7-8). 

Treatment  for  Production  Rate 

As  provided  by  the  manufacturer,  the  data  contained 
no  production  rate,  other  than  the  equivalent  units  pro¬ 
duced  per  accounting  month.  Therefore,  this  independent 
variable  was  treated  as  follows: 

1.  X2a  stands  for  the  daily  average  production 
rate  variable.  Where  X2a  is  used,  the  production  rate 
variable  represents  the  daily  average  production  rate  per 
accounting  month.  It  is  derived  by  dividing  the  equiva¬ 
lent  units  produced  during  an  accounting  m*onth  by  the 


nuab«c  oC  wockinq  days  in  that  accounting  month,  as  pro- 
vidad  by  tha  manufacturar . 

2.  X2e  stands  Cor  tha  cumulative  average  produc¬ 
tion  rate  variable,  where  X2c  used,  the  production 
rate  variable  is  the  cumulative  average  of  the  daily 
average  production  rates,  whose  derivation  was  just 
described. 

3.  X2ni  stands  for  the  monthly  production  rate 
variable.  Where  X21Q  is  used,  the  production  rate  variable 
simply  represents  the  number  of  equivalent  units  produced 
during  an  accounting  month,  as  provided  by  the  manufac¬ 
turer. 

With  tha  dependent  variable  designated  and  the 
distinctions  among  variables  and  the  forms  of  each  vari¬ 
able  outlined.  Table  3  is  provided  as  a  quick  reference. 
The  table  should  prove  useful,  as  various  cost  models  and 
their  variables  are  introduced,  discussed,  analyzed,  and 
referred  to  throughout  the  remainder  of  this  paper. 
Moreover,  the  table  serves  as  a  reminder  that  in  searching 
for  a  predictive  model,  one  must  look  at  as  many  potential 
treatments  of  data  as  time  and  other  resources  allow. 

Beyond  the  treatment  of  the  variables,  the  treat¬ 
ment  of  the  data  base  itself  was  of  importance.  In  lieu 

of  sample,  the  assumption  of  population  census  was  used. 

« 

Therefore,  statistics  derived  for  each  individual  popula¬ 
tion  were  descriptive  of  only  that  population.  Those 
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TABLE  3 


OVERVIEW  OF  MODELS  AND  THEIR  VARIABLES 


Model 

Direct  Labor 
Hours 

Cumulative 

Output 

Production 

Rate 

1 

Xla 

X2a 

2 

^c 

Xl 

X2a 

3 

Yu 

Xla 

X2C 

4 

Yc 

Xl 

X2C 

5 

Yt 

Xl 

X2m 

Where : 
in  Y; 


in  Xi; 


in  X2: 


u  is  unit  cost,  or  average  direct  labor  hours 
per  equivalent  unit  per  accounting  month; 

c  is  cumulative  average  cost,  or  cumulative 
average  direct  labor  hours  per  equivalent 
unit;  and 

t  is  total  cost,  or  total  direct  labor  hours 
per  accounting  month. 

a  is  cumulative  output  adjusted,  or  adjusted 
plotpoints  for  cumulative  production  in 
equivalent  units.  The  absence  of  an  alpha 
subscript  indicates  no  adjustment  was 
requited . 

a  is  average  rate,  or  daily  average  produc¬ 
tion  rate  per  accounting  month; 

c  is  cumulative  average  rate,  or  cumulative 
average  of  the  daily  average  production 
rates  per  accounting  months;  and 

m  is  monthly  rate,  or  the  monthly  production 
rate,  as  represented  by  the  /lumber  of 
equivalent  units  produced  pet  accounting 
month. 
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statistics  vers  limited  by  the  methodology/  the  assump¬ 
tions  of  the  models,  and  the  models'  explanatory  powers. 
Consequently,  applicability  of  the  regression  coefficients 
was  necessarily  limited  to  the  individual  avionics  program 
from  which  the  coefficients  were  derived. 

Summary  of  Methodology,  Assumptions 
and  Limitations 

The  approach  was  to  analyze  historical  production 
data  by  using  least  squares  multiple  linear  regression 
analysis.  Statistical  and  criterion  tests  were  structured 
for  testing  the  research  hypotheses. 

To  evaluate  the  first  research  hypothesis,  statisti¬ 
cal  tests  were  constructed  to  investigate  in  an  appropri¬ 
ate  model  the  hypothesized  effect  of  production  rate 
changes  on  direct  labor  requirements  in  avionics  produc¬ 
tion.  Two  criterion  tests  were  used  for  judging  the  appro¬ 
priateness  of  the  model.  If  both  statistical  tests  and 
both  criterion  testa  were  passed,  the  full  model  was  vali¬ 
dated.  The  conclusion  to  follow  was  that  production  rate 
was  an  important  explainer  of  the  variation  in  total 
direct  labor  requirements  for  avionics  production. 

To  evaluate  the  second  research  hypothesis,  the 
predictive  abilities  of  the  full  and  reduced  models  were 
compared  over  an  eighteen  month  time  span.*.  A  statistical 
test  was  employed  to  determine  if  the  predictive  ability 
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of  the  full  model  was  significantly  better  than  the  pre¬ 
dictive  ability  of  the  reduced  model.  In  addition,  a  cri¬ 
terion  test  was  used  to  determine  which  model  had  the 
better  practical  predictive  ability.  The  objective  here 
was  to  demonstrate  that  the  improvement  in  predictive  abi¬ 
lity  achieved  by  the  full  model  was  not  only  statistically 
significant  but  of  practical  value  as  well. 

The  strength  and  validity  of  the  conclusions  asso¬ 
ciated  with  the  research  hypotheses  must  necessarily  be 
evaluated  in  terms  of  the  assumptions  and  limitations 
inherent  in  the  methodology.  In  that  context,  a  recap  of 
the  assumptions  and  limitations  is  listed. 

Assumptions 

Historical  data  obtained  from  the  manufacturer  were 
recorded  accurately  and  appropriately  attributed  to  equiv¬ 
alent  units  they  applied  to. 

Multicollinear ity  did  not  importantly  impair  the 
short  range  predictive  ability  of  the  models. 

The  data  were  accurately  measured  and  adjusted  for 
inequalities,  such  as  differing  sizes  of  accounting 
months,  particularly  for  production  rate  and  lot  midpoint 
calculations . 

Logarithmic  transformation  of  the  data  to  facilitate 
multiple  linear  regression  analysis  introduced  no  signifi¬ 
cant  loss  of  data  precision. 
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In  litu  o2  sanplts,  population  census  was  assumed  for 


each  data  base. 

Autocorrelation  did  exist  to  some  degree,  but  was 
Insufficient  to  preclude  achievement  of  the  research 
objectives . 

Limitations 

Subjective  analysis  was  required  to  evaluate  the 
actual  residuals  compared  to  the  assumptions  of  the 
theoretical  residuals. 

Limited  number  of  data  points  (both  programs  fewer 
than  sixty)  resulted  in  reduction  of  statistical  "lever¬ 
age”  (i.e.,  limited  degrees  of  freedom). 

The  applicability  of  the  results  of  the  research 
was  constrained  to  the  particular  programs  whose  obser¬ 
vations  constituted  the  data  bases. 


I 


52 


CHAPTER  IV 


DATA  ANALYSIS  AND  EVALUATION 

This  chapter  presents  the  unbiased  results  of  anal¬ 
ysis  of  the  two  avionics  production  programs  and  their 
data  sets.  It  is  divided  into  three  sections.  Sections 
one  and  two  briefly  describe  the  production  programs,  the 
results  of  hypothesis  testing  using  the  models  described 
in  Chapter  III,  and  the  major  findings.  The  last  section 
compares  and  contrasts  the  findings  in  terms  of  both  the 
production  program  environment  and  the  statistical 
results,  and  it  evaluates  the  overall  applicability  of  the 
cumulative  production  and  production  rate  model  for  the 
two  programs. 


The  Maqnavox  Data 

The  data  obtained  from  the  Magnavox  Government  and 
Industrial  Electronics  Company  consisted  of  the  production 
direct  labor  requirements  for  the  ARC-164  radio.  The  data 
were  composed  of  thirty-nine  data  points,  stretching  from 
the  program's  beginning  in  August  1975  through  October 
1978.  This  ongoing  program  made  an  ideal  test  situation 
for  the  extension  and  application  of  both  ,the  learning 
curve  and  the  cumulative  production  and  production  rate 
models  in  the  area  of  avionics  production  (3:97). 
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Th«  raw  data  were  manipulated  as  described  in  the 
explanation  of  the  individual  variables  for  each  of  the 
models  presented  in  Chapter  ZIZ.  Regression  analysis  was 
performed  on  both  the  full  and  reduced  forms  of  the 
models r  and  test  statistics  were  calculated. The  test 
statis-ics  wer-  then  compared  with  the  critical  values 
required  and  the  criterion  tests  were  applied  to  determine 
whether  or  not  the  first  research  hypothesis  was  sup¬ 
ported.  Zf  the  results  obtained  for  a  particular  model 
supported  research  hypothesis  one  and  the  criterion  test 
failed  to  reject  the  model  as  inappropriate,  that  model 
was  then  tested  for  support  of  research  hypothesis  two. 

Zn  this  manner,  unnecessary  testing  of  inappropriate 
models  was  avoided. 

Analysis  of  Research 
Hypothesis  One 

For  ease  of  reference  and  understanding,  the  sta¬ 
tistical  hypotheses  and  criterion  teats  for  research 
hypothesis  one  are  summarized  and  restated  as  follows: 


^^The  primary  regression  results  used  throughout 
this  research  were  obtained  through  use  of  Smith's  FOR¬ 
TRAN  ZV  program  (21:147-153)  which  was  extensively 
modified  by  the  authors.  This  modified  program  is  listed 
and  described  in  Appendix  A.  In  addition,  the  program  has 
been  made  available  for  use  by  government  price  analysts 
through  the  COPPER  IMPACT  Library  under  the  file  name 
PROD RATE. 
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Research  Hypothesis  One.  Production  rate  is  an 
important  explainer  of  the  variation  in  total  direct  labor 
requirements  for  avionics  production  when  included  in  an 
appropriate  model. 

Statistical  Hypothesis  One  (A) .  Hq;  and  B2  ■  0; 
Ha;  3i  0  and/or  B2  /  0.  Reject  Hq  if  F  Ratio  is 
greater  than  Fq. 

Statistical  Hypothesis  One  (B) ;  Hq:  B2  *  0;  Hj: 

B2  /  0;  Reject  Hg  if  F*  is  greater  than  Fq. 

Criterion  Test  One  (A) .  The  model's  appropriate¬ 
ness  cannot  be  rejected  if  an  analysis  of  the  residuals 
indicates  the  assumptions  of  constant  variance,  indepen¬ 
dence,  and  normality  are  not  violated. 

Criterion  Test  One  (B) .  The  model's  appropriate¬ 
ness  cannot  be  rejected  if  the  computed  r2  and  r2  (actual) 
exceed  85  percent. 

The  results  of  testing  for  research  hypothesis  one 
are  presented  in  tabular  format  for  each  model  tested.  At 
this  point  it  is  necessary  to  remind  the  reader  that  all 
of  the  models  were  of  the  same  basic  form.  That  is,  each 
reduced  model  contained  a  dependent  variable  representing 
direct  labor  requirements  and  an  independent  variable 
representing  cumulative  production.  Likewise,  each  full 


model  contained  the  same  dependent  variable  representing 
direct  labor  requirements,  the  same  independent  variable 
representing  cumulative  production,  and  an  additional  inde¬ 
pendent  variable  representing  production  rate.  The  only 
difference  among  the  models  was  the  manner  in  which  the 
historical  data  were  aggregated.  To  insure  these  dis¬ 
tinctions  remain  clear,  each  model  is  briefly  restated 
prior  to  the  presentation  of  the  teat  results. 


Model  1.  The  results  of  Model  1  are  contained  in 
Table  4.  Reduced  model: 

Bl 


Yu  ■  •  X, 


'0  “la 


or  in  logarithmic  form: 


log  (Yy)  -  log  (Bg)  +  •  log  (Xj^^) 


Full  model: 


Bl  B2 

Vafi  •X  * 

*u  na  *2a 


or  in  logarithmic  form: 

log  (Y|j)  -  Log  (Bg)  +  Bj_  •  log  (Xj^^)  +  Bj  *  log  (Xj^) 

where: 


Yj^  •  unit  coat  (direct  labor  hours/jiquivalent  unit/ 
accounting  month) 


56 


TABLE  4 


RESEARCH  HYPOTHESIS  ' 

ONE 

RESULTS  FOR  MAGNAVOX 

MODEL  1 

Reduced 

Test  Items 

Model 

Full  Model 

Estimated  Bq 

masked^ 

masked 

Estimated  Bx 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

189.33 

109.87 

F  Critical  (2,36) 

- - 

3.25 

Statistical  Hypothesis 

lA 

____ 

Reject  Hq 

F* 

— 

5.81 

F  Critical  (1,36) 

____ 

4.11 

Statistical  Hypothesis 

IB 

— — 

Reject  Hq 

Residual  Plot^ 

— — 

Unacceptable 

Criterion  Test  lA 

____ 

Failed 

r2 

.836 

.859 

r2  (actual) 

.482 

.579 

Criterion  Test  IB 

Failed 

*Data  are  considered  proprietary  by  the  manufac¬ 
turer.  Accordingly,  numerous  table  values  have  been 
masked  in  the  published  version  of  this  thesis.  Access  to 
these  data  can  be  obtained  from  the  authors  upon  written 
approval  of  Magnavox  Government  and  Industrial  Electronics 
Company . 

w 

Kesidual  plots  were  obtained  through  the  use  of 
Statistical  Package  for  the  Social  Sciences  (SPSS)  rou¬ 
tines  (18:320-367). 
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-  cumul*tiv«  output  plot  point  adjusted  to  lot 
midpoint. 

*2a  “  averaga  production  rate/accounting 

month. 

asastj-  Th.  cult.  o(  Mod.!  2  .«  coot.lnwJ  U 
Table  5.  Reduced  model: 

Y  ■  •  X 

*C  0  "1 

los®rithmic  form: 

log  (Yc)  -  log  (Bq)  +  Bj^  •  log  (Xj^)  . 

Full  model: 

<=  0  1  *2a 

or  in  logarithmic  form: 

109  (Y^)  .  LO,  (B,,  *  Bj  .  10,  (Xj,  .  Bj  .  10,  ,Xj,)  . 

where: 

-  cumulative  average  cost  (cumulative  average 
direct  labor  hours/equivalent  unit). 

-  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) . 

Xja  •  daily  average  production  rateAccounting 
month. 


TABLE  5 


RESEARCH  HYPOTHESIS 

ONE 

RESULTS  FOR  MAGNAVOJ( 

:  MODEL  2 

Reduced 

Test  Items 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  B^ 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

284.80 

155.12 

F  Critical  (2,36) 

— 

3.25 

Statistical  Hypothesis 

lA 

____ 

Reject  Hq 

F* 

____ 

3.81 

F  Critical  (1,36) 

4.11 

Statistical  Hypothesis 

IB 

-  Fail 

to  Reject  Hq 

Residual  Plot 

Unacceptable 

Criterion  Test  lA 

— 

Failed 

r2 

.885 

.896 

r2  (actual) 

.816 

.828 

5tod£l_3.  Th*  results  of  Model  3  are  contained  in 
Table  6.  Reduced  model: 


^u  ■  Bq  • 

or  in  logarithmic  form; 

log  (T^)  •  log  (Bq)  +  •  log  . 

Full  model: 

y.,  -  B«  .  X,.®1  .  X.  ®2 


u  -0  na 
or  in  logarithmic  form: 


‘2c 


log  (Y^^)  .  Log  (Bq)  +  •  log  (x^^)  +  B2  •  log  (X2^) 

where: 


Yy  •  unit  cost  (direct  labor  hours/equivalent  unit/ 
accounting  month) 

-  cumulativre  output  plot  point  adjusted  to  lot 
midpoint. 

Xjg  -  cumulative  average  of  the  daily  average  pro¬ 
duction  rates  for  accounting  months  to  date. 

Model^.  The  results  of  Model  4  are  contained  in 
Table  7.  Reduced  model: 

^C  •  Bg  .  Xj^®l  ' 
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TABLE  6 


RESEARCH  HYPOTHESIS 

ONE 

RESULTS  FOR  MAGNAVOX 

MODEL  3 

Reduced 

Tested  Items 

Model 

Full  Model 

Estimated  Bg 

masked 

masked 

Estimated  3]^ 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

189.33 

518.33 

F  Critical  (2,36) 

— 

3.25 

Statistical  Hypothesis 

lA 

— 

Reject  Hq 

F* 

— 

139.36 

F  Critical  (1,36) 

— 

4.11 

Statistical  Hypothesis 

IB 

— 

Reject  Hq 

Residual  Plot 

— 

Acceptable 

Criterion  Test  lA 

— 

Passed 

r2 

.837 

.966 

r2  (actual) 

.482 

.950 

Criterion  Test  IB 

Passed 

TABLE  7 


RESEARCH  HYPOTHESIS  ONE  RESULTS  FOR  MAGNAVOX  MODEL  4 


Test  Items 

Reduced 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  B], 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

284.02 

583.13 

F  Critical  (2,36) 

— 

3.25 

Statistical  Hypothesis  lA 

— 

Reject  Hq 

P* 

— 

102.23 

F  Critical  (1,36) 

— 

4.11 

Statistical  Hypothesis  IB 

— — 

Reject  Hq 

Residual  Plot 

Unacceptable 

Criterion  Test  lA 

— — 

Failed 

r2 

.385 

.970 

r2  (actual) 

.816 

.965 

Criterion  Test  IB 

Passed 
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or  in  Logarithmic  form: 


log  (Y^)  -  log  (Bq)  +  •  log  {X^) . 


Full  model: 


or  in  logarithmic  form: 


log  (Y^)  =  Log  (Bq)  +  B^^  •  log  (X^^)  +  B2  *  log  . 

where : 

Y  »  cumulative  average  cost  (cumulative  average 
direct  labor  hours/equivalent  unit) 
a  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) . 


Xjj,  ■  cumulative  average  of  the  daily  average  pro¬ 
duction  rates  for  accounting  months  to  date. 


Model  5.  The  results  of  Model  5  are  contained  in 
Table  8.  Reduced  model: 


Y 


or  in  logarithmic  form; 


log  (Y^)  ■  log  (Bq)  +  Bj_  •  log  (X^^)  . 
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TABLE  8 


RESEARCH  HYPOTHESIS 

ONE 

RESULTS  FOR  MAGNAVOX 

MODEL  5 

Tested  Items 

Reduced 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  B^ 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

0.02 

36.57 

F  Critical  (2,36) 

« — - 

3.25 

Statistical  Hypothesis 

lA 

— — 

Reject  Hq 

F* 

— 

73.06 

F  Critical  (1,36) 

— — 

4.11 

Statistical  Hypothesis 

IB 

— 

Reject  Hq 

Residual  Plot 

Acceptable 

Criterion  Test  lA 

— — 

Passed 

r2 

.001 

.670 

r2  (actual) 

.022 

.567 

Criterion  Test  IB 

— - 

Failed 

Full  model: 


Y 


t 


or  in  logarithmic  form: 


log  (Y^.) 


Log  (Bq)  +  •  log  (X^)  +  B2  •  log  (X2.„j  ^ 


where : 

Y^  ■  unit  cost  (direct  labor  hours/accounting 
month) . 

Xj^  ■  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) . 

^2a  *  monthly  production  rate  (equivalent  units 
produced/accounting  month) . 


Research  Hypothesis  One 
Analysis  Summary 

As  indicated  in  Tables  4  through  8,  only  Magnavox 
Model  3  was  validated  for  further  testing  under  research 
hypothesis  two.  It  should  also  be  noted  that  the  addi¬ 
tional  variation  explained  by  the  inclusion  of  the  pro¬ 
duction  rate  variable  [tested  by  statistical  hypothesis 
one  (b) ]  was  held  to  be  statistically  significant  at  the 
0.05  level  of  significance  in  all  cases  except  one  (Magna¬ 
vox  Model  2).  However,  even  in  the  case  of  Magnavox 
Model  2  rejection  of  Hq  for  statistical  hypothesis  one  (B) 
would  have  occurred  if  tested  at  the  0.06  level  of  signif¬ 
icance.  It  is  concluded,  therefore,  that  research 
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hypothesis  one  was  supported  by  the  results  obtained 
through  analysis  of  the  Magnavox  data. 

^alysis  of  Research 
Hypothesis  two 

Analysis  of  the  predictive  ability  of  Magnavox 
Model  3  was  conducted  using  the  computer  program  listed  in 
Appendix  A.  This  program  contains  an  option  that  permits 
the  researcher  to  perform  stepwise  truncation  of  input 
data  points  and  simulate  predictions  of  direct  labor 
requirements.  Predicted  values  are  compared  with  the 
observed  values  and  any  deviation  is  computed  both  as  an 
absolute  deviation  and  as  a  percentage  of  the  observed 
value.  Since  this  process  is  carried  out  simultaneously 
for  both  the  full  and  reduced  models,  it  permits  a  com¬ 
parison  of  the  predictive  ability  of  the  learning  curve 
with  the  cumulative  production  and  production  rate  model. 

As  an  example,  if  the  input  data  base  contains 
thirty-nine  data  points  (as  in  the  case  of  the  Magnavox 
data),  the  last  data  point  (case  number  39)  is  truncated. 
Regression  coefficients  are  computed  for  the  full  and 
reduced  models  using  thirty-eight  data  points  and  these 
coefficients  are  used  to  predict  the  direct  labor  require¬ 
ments  for  case  number  39.  The  predicted  values  for  the 
full  and  reduced  models  are  subtracted  from  the  observed 
values  and  the  absolute  value  of  the  resulting  deviations 
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is  stored  in  an  array  for  use  in  the  test  of  statistical 
hypothesis  two.  The  deviation  is  also  divided  by  the 
observed  value  and  multiplied  by  100  to  arrive  at  a  per¬ 
centage  deviation  for  use  in  criterion  test  two. 

The  above  process  is  repeated  for  case  number  39 
using  the  original  data  base  truncated  to  37,  36,  ...  etc. 
data  points.  The  stepwise  truncation  continues  until  a 
prediction  of  case  number  39  has  been  made  from  data  points 
eighteen  months  prior  to  case  number  39,  and  the  entire 
procedure  is  repeated  for  cases  38  through  21.  In  data 
bases  where  the  data  points  represent  one-month  intervals, 
this  procedures  result  in  324  test  situations  and  pro¬ 
vides  a  subjective  test  of  a  model's  predictive  ability. 

An  example  of  the  computer  printout  obtained  for 
case  number  39  (the  last  data  point)  of  the  Maganvox 
Model  3  data  base  is  presented  in  Figure  1.  In  addition,  a 
complete  computer  run,  using  simulated  data,  is  included 
with  the  listing  of  the  program  PRODRATE  in  Appendix  A. 

For  ease  of  reference  and  understanding,  the  sta¬ 
tistical  hypothesis  and  criterion  test  for  research 
hypothesis  two  are  summarized  and  restated  as  follows: 

Research  Hypothesis  Two.  For  eighteen  months  into 
the  future  the  predictive  ability  of  the  full  model  is 
better  that  the  predictive  ability  of  the  ceduced  model. 


Statistical  Hypothesis  Two.  iDj^l  <  'Dj,i  ; 

”a'  ^  R«3ect  Hg  if  Z  >  Z^  (.05). 

Criterion  Test  Two.  The  model  with  the  better 
practical  predictive  ability  is  the  model  whose  percent 
deviations  more  frequently  fall  in  the  excellent  (  5  per¬ 
cent)  or  good  (  10  percent)  categories  over  the  range  of 
all  test  situations. 

Research  Hypothesis  Two 
Analysis  Summary 

A  summary  of  the  predictive  ability  tests  conducted 
for  research  hypothesis  two  on  Model  3  of  the  Magnavox 
data  is  contained  in  Table  9.  These  results  clearly  indi¬ 
cate  that  the  full  model  was  a  better  predictor  of  direct 
labor  requirements  than  was  the  reduced  model.  Not  only 
was  the  full  model's  predicted  value  consistently  closer 
to  the  observed  value,  but  the  full  model's  predictive 
ability  showed  more  stability  over  the  range  of  data 
tested.  It  would  naturally  be  expected  that  the  pre¬ 
dictions  made  by  both  models  would  gradually  become  less 
accurate  as  the  number  of  data  points  used  in  formulating 
the  regression  coefficients  decreased.  This  trend  was 
observed  in  the  predictive  ability  test  for  both  models, 
but  the  full  model  demonstrated  much  less  loss  of  precision 
as  data  points  were  decreased  than  did  the*  reduced  model. 
In  addition,  the  reduced  model  was  observed  to  consis¬ 
tently  overestimate  the  direct  labor  requirements  in  every 


69 


TABLE  9 


RESEARCH  HYPOTHESIS  TWO  RESULTS  FOR 
MAGNAVOX  MODEL  3 


Test  I tens 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

37.63 

5.30 

Variance 

605.34 

43.61 

Z  Test  Statistics 

22.85 

Z  critical 

— — 

1.65 

• 

Statistical  Hypothesis  Two 

— — 

Reject  Hq 

Total  number  of  test 
situations 

324 

324 

Total  number  of  excellent 

predictions  (within  5  percent) 

0 

159 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

5 

250 

Criterion  Test  Two 

Passed 
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test  situation  I  while  no  such  trend  was  observed  for  the 
full  model. 

In  summary,  therefore,  research  hypothesis  two  was 
considered  supported  by  the  results  obtained  in  the  pre¬ 
dictive  ability  tests  conducted  on  the  Magnavox  data. 

The  Teledyne  Data 

The  data  provided  by  the  Teledyne  Systems  Company 
consisted  of  production  direct  labor  requirements  for  the 
Computer  Signal  Data  Converter  (CSDC) .  Made  up  of  forty- 
seven  data  points,  the  data  represented  accounting  months 
from  January  1975,  when  full-scale  production  commenced, 
through  November  1978.  Like  the  Magnavox  data,  the 
Teledyne  data  pertained  to  an  ongoing  program  and  thus 
were  good  candidates  for  this  research  (8:97).  In  addi¬ 
tion,  the  production  rate  of  the  CSDC  had  been  constrained 
since  December  1977  by  a  government  slowdown  in  the  rate 
of  delivery  of  these  units.  This  additional  fact  enhanced 
the  test  situation  for  observing  the  effect  of  an  exoge¬ 
nous  change  in  production  rate  on  direct  labor  require¬ 
ments  . 

The  raw  CSDC  production  data  were  treated  as 
described  in  the  explanation  of  individual  variables  for 
each  of  the  models  presented  in  Chapter  III.  Regression 
analysis  technique,  statistical  hypothesis, testing ,  and 
criterion  testing  for  research  hypotheses  one  and  two  were 
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p«r formed  in  exactly  tha  same  aannac  as  performed  on  the 
Magnavox  data. 

Analysis  of  Research 
Hypothesis  One 

Once  again,  to  insure  the  distinctions  among  models 
remain  clear,  each  model  is  briefly  restated  prior  to  the 
tabular  presentation  of  the  test  results. 


Model  1.  The  results  of  Model  1  are  contained  in 
Table  10.  Reduced  model: 


-  Bg 


or  in  logarithmic  form: 


log  (Yy)  -  log  (Bq)  +  •  log  . 

Full  model: 


Y 


u 


B, 


or  in  logarithmic  form: 


log  (Yy)  -  Log  (Bg)  +  B^  •  log  (X^^^)  +  Bj  •  log  . 

»rhere : 

(direct  labor  hours/equivalent  unit/ 
accounting  month)  • 

Xj^a  ■  cumulative  output  plot  point  adjusted  to  lot 
midpoint. 
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TABLE  10 


RESEARCH  HYPOTHESIS 

ONE 

RESULTS  FOR  TELEDYNE 

MODEL  1 

Reduced 

Tested  Items 

Model 

Full  Model 

Estimated  Bq 

masked* 

masked 

Estimated  B}, 

masked 

masked 

Estimated  B2 

____ 

masked 

P  Ratio 

3.39 

16.85 

F  Critical  (2,44) 

— 

3.21 

Statistical  Hypothesis 

lA 

— 

Reject  Hq 

P* 

— 

28.25 

F  Critical  (1,44) 

— 

4.06 

Statistical  Hypothesis 

IB 

Reject  Hq 

Residual  Plot*^ 

— 

Acceptable 

Criterion  Test  1 

— 

Passed 

r2 

.070 

.434 

r2  (actual) 

.073 

.433 

Criterion  Test  2 

Failed 

*Data  are  considered  proprietary  by  the  manufac¬ 
turer.  Accordingly,  numerous  table  values  have  been 
masked  in  the  published  version  of  this  thesis.  Access  to 
these  data  can  be  obtained  from  the  authors  upon  written 
approval  of  the  Teledyne  Systems  Company. 

^Residual  plots  were  obtained  through  the  use  of 
Statistical  Package  for  the  Social  Sciences  (SPSS)  rou¬ 
tines  (18:320-367). 
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X2^  ■  daily  average  production  rate/accounting 
month. 

Model  2.  The  results  of  Model  2  are  contained  in 
Table  11.  Reduced  model: 

Bl 

^c  "  ®0  •  *1 
or  in  logarithmic  form: 


log  (Yc)  •  log  (Bq)  +  •  log  (Xj^) . 

Full  model: 


Y 


c 


B, 


or  in  logarithmic  form: 


log  (Y^)  -  Log  (Bq)  +  B^  •  log  (Xj^)  +  •  log  (Xj^) . 

where: 


Y-  «  cumulative  average  cost  (cumulative  average 

W 

direct  labor  hours/equivalent  unit) . 

X^  ■  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) . 

^2a  *  average  production  rate/accounting 

month . 

Model  3.  The  results  of  Model  3  are  contained  in 

e 

Table  12.  Reduced  model: 
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TABLE  11 


RESEARCH  HYPOTHESIS  ONE  RESULTS  FOR  TELEDYNE  MODEL  2 


Test  Items 

Reduced 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  B], 

masked 

masked 

Estimated  B2 

— — 

masked 

P  Ratio 

940.85 

545.55 

F  Critical  (2,44) 

— — 

3.21 

Statistical  Hypothesis  lA 

— — 

Reject  Hq 

P* 

7.81 

P  Critical  (1,44) 

4.06 

Statistical  Hypothesis  IB 

— 

Reject  Hq 

Residual  Plot 

— — 

Unacceptable 

Criterion  Test  1 

Failed 

r2 

.954 

.961 

r2  (actual) 

.955 

.962 

Criterion  Test  2 

Passed 

Passed 


TABLE  12 


RESEARCH  HYPOTHESIS  ONE 

RESULTS  FOR  TELEDYNE 

MODEL  3 

Reduced 

Test  Items 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  Bi 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

3.39 

21.85 

F  Critical  (2,44) 

3.21 

Statistical  Hypothesis 

lA 

— 

Reject  Ho 

?* 

— 

37..  55 

F  Critical  (1,44) 

— 

4.06 

Statistical  Hypothesis 

IB 

— 

Reject  Ho 

Residual  Plot 

— 

Acceptable 

Criterion  Test  1 

— 

Passed 

r2 

,070 

.498 

r2  (actual) 

.073 

.502 

Criterion  Test  2 

— 

Failed 
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or  in  logarithmic  form: 


log  (Yy)  -  log  (Bq)  +  •  log 


Full  model: 


Bi  B2 

^u  -  Bq  •  ^la  *^20 


or  in  logarithmic  form: 


log  (Yy)  -  Log  (Bq)  +  •  log  •  log  (X2c)  • 

where : 


'la 


'2c 


unit  cost  (direct  labor  hours/equivalent  unit/ 
accounting  month) 

cumulative  output  plot  point  adjusted  to  lot 
midpoint. 

cumulative  average  of  the  daily  average  pro¬ 
duction  rates  for  accounting  months  to  date. 


Model  4.  The  results  of  Model  4  are  contained  in 
Table  13.  Reduced  model: 


^c  •  ®o  •  h 


Bl 


or  in  logarithmic  form: 


log  (Y^)  -  log  (Bq)  +  Bj_  •  log  (Xj_) 
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TABLE  13 


RESEARCH  HYPOTHESIS  ONE  RESULTS  FOR  TELEDYNE  MODEL  4 


Test  Items 

Reduced 

Model 

Full  Model 

Estimated  Bq 

masked 

masked 

Estimated  B], 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

940.85 

681.88 

F  Critical  (2,44) 

— 

3.21 

Statistical  Hypothesis  lA 

— — 

Reject  Hq 

F* 

— 

20.26 

F  Critical  (1,44) 

— 

4.06 

Statistical  Hypothesis  IB 

— 

Reject  Hq 

Residual  Plot 

— 

Unacceptable 

Criterion  Test  1 

— 

Failed 

r2 

. .  "4 

.969 

r2  (actual) 

.955 

.968 

Criterion  Test  2 

Passed 

L 
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Full  model: 


®1  ^2 
Y  «  B-  •  X,  •  X,  ^ 
C  0  1  2c 


or  in  logarithmic  form: 


log  (Y^)  -  Log  (Bq)  +  •  log  (Xj^)  +  B2  •  log  (Xj^) 


where ; 


Y^  ■  cumulative  average  cost  (cumulative  average 
direct  labor  hours/equivalent  unit) 

Xj^  «  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) . 

X2j,  *  cumulative  average  of  the  daily  average  pro¬ 
duction  rates  for  accounting  months  to  date. 


Model  5.  The  results  of  Model  5  are  contained  in 
Table  14.  Reduced  model: 


or  in  logarithmic  form: 


log  (Y^)  »  log  (Bq)  +  B^  •  log  (X^) 


Full  model: 


Bi  B2 

^  -  ^0  •  "l  •  ^2m 


or  in  logarithmic  form: 


log  (Y^)  »  Log  (Bg)  +  B^  •  log  {K^)  +  3^  •  log  (X2^) 
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TABLE  14 


RESEARCH  HYPOTHESIS 

ONE 

RESULTS  FOR  TELEDYNE 

MODEL  5 

Reduced 

T«at  Items 

Model 

Pull  Model 

Estimated  Bq 

masked 

masked 

Estimated  B], 

masked 

masked 

Estimated  B2 

— 

masked 

F  Ratio 

17.45 

1,330.95 

P  Critical  (2,44) 

- . 

3.21 

Statistical  Hypothesis 

lA 

— 

Reject  Hq 

P* 

— 

1,905  79 

P  Critical  (1,44) 

— 

4. 06 

Statistical  Hypothesis 

IB 

— 

Reject  Hg 

Residual  Plot 

— 

Acceptable 

Criterion  Test  1 

— 

Passed 

r2 

.279 

.984 

r2  (actual) 

.235 

.981 

Criterion  Test  2 

— 

Passed 
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wh«c«: 


■  total  cost  (total  direct  Labor  houra/account- 
ing  month) . 

■  cumulative  output  plot  points  (cumulative 
unita  at  end  of  accounting  month) . 

*2m  "  production  rate  (equivalent  unita  pro¬ 

duced)  . 

Research  Hypothesis  One 
Analysis  Sununary 

As  indicated  in  Tables  10  through  14,  only  Teledyne 
Model  S  was  validated  for  further  testing  under  research 
hypothesis  two.  As  in  the  case  of  the  Magnavox  data, 
regression  analysis  of  the  Teledyne  data  indicated  the 
addition  of  the  production  rate  variable  added  signifi¬ 
cantly  to  the  explanation  of  variations  in  the  direct 
labor  hour  requirements.  In  fact,  the  results  of  testing 
for  statistical  hypothesis  one  (B)  in  each  model  demon¬ 
strated  that  the  explanatory  power  added  by  the  production 
rate  variable  was  statistically  significant  at  the  O.OS 
level  of  significance  in  all  models.  These  results  sup¬ 
port  the  validity  of  research  hypothesis  one  for  the 
Teledyne  data. 

Model  S  was  then  tested  for  predictive  ability 
under  research  hypothesis  two. 
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An4lv« is  of  R««<arch 
Hypothsais  Two 

Analysis  of  tha  prsdletiys  ability  of  Tsladyna 
Modal  S  was  conductad  in  axactly  tha  Sana  mannar  as 
dasccibad  for  tha  Magnavox  data.  An  axampla  of  tha  com- 
putar  printout  for  casa  nunbar  47  (tha  last  data  point)  of 
tha  Taladyna  data  is  prasantad  in  Figura  2. 

Rasaarch  Hypothasis  Two 
Analysis  Sunmary 

A  sunnary  of  tha  pradictiva  ability  tasts  conductad 
for  rasaarch  hypothasis  two  on  Modal  5  of  tha  Taladyna 
data  la  contalnad  in  Tabla  15.  ‘*fhasa  raaults  damonatrata 
that  tha  full  nodal  was  a  battar  pradictor  of  diract  labor 
raqulranants  than  was  tha  raducad  nodal.  Onca  again,  as 
originally  obsarvad  in  tha  Magnavox  Modal  3  tasting,  tha 
raducad  modal  consistantly  ovarastinatad  tha  diract  labor 
hours  varlabla  in  tha  najority  of  tha  situations. 

Xn  sunmary,  tharafora,  rasaarch  hypothasis  two  was 
considarad  supportad  by  tha  rasults  obtalnad  in  tha  pra- 
dlctiva  ability  tasts  conductad  on  tha  Taladyna  data. 

Piffarancas,  Sinilarltlas 
an<^  Sunnary 

Of  tha  tan  nodals  invastigatad  (fiva  for  aach  data 
sat) ,  thara  wara  obvious  diffarancas  and  sinilarltlas  bat- 
waan  tha  Magnavox  data  and  tha  Taladyna  da.ta.  First,  tha 
diffarancas  will  ba  contrastad;  than  tha  sinilarltlas  will 
ba  addrassad.  Finally,  a  sunnary  of  tha  rasaarch  findings 
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TABLE  IS 

RESEARCH  HYPOTHESIS  TWO  RESULTS  FOR 
TELEOYHE  MODEL  5 


Test  Zteos 

Reduced 

Model 

Pull 

Model 

Average  absolute  deviation 

1,691.46 

195.16 

Variance 

627,855.45 

17,587.80 

2  Test  Statistics 

— 

33.52 

2  critical 

— 

1.65 

Statistical  Hypothesis  Two 

— 

Reject  Hq 

Total  nuaiber  of  test 
situations 

324 

324 

Total  nunber  of  excellent 

predictions  (within  S  percent) 

15 

227 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

35 

315 

Criterion  Test  Two 


Passed 


and  an  overall  evaluation  of  the  applicability  of  the 
cunulative  production  and  production  rate  model  to  the  two 
data  sets  will  close  Chapter  IV. 

Differences 

The  reader  is  probably  struck  first,  as  the 
researchers  were,  by  the  fact  that  the  best  predictive 
model  was  not  the  same  model  for  the  two  data  sets.  Upon 
reflection,  however,  this  difference  was  not  a  surprise 
because  each  individual  firm  can  be  as  different  as  are 
various  products  or  industries.  For  the  Magnavox  data, 
the  best  predictor  was  Model  3,  whose  dependent  variable 
was  average  direct  labor  hours  per  equivalent  unit  per 
accounting  month.  The  X2  independent  variable  in  Model  3 
for  the  Magnavox  data  was  represented  by  the  cumulative 
average  of  the  daily  average  production  rate.  For  the 
Teledyne  data,  however,  the  best  predictor  was  Model  5 
whose  dependent  and  X2  independent  variables  were  total 
labor  hours  per  accounting  month  and  monthly  production 
rate,  respectively. 

The  researchers  concluded  the  difference  was 
accounted  for  by  the  dissimilar  environments  of  the  two 
production  programs.  For  example,  the  Magnavox  production 
was  characterized  by  direct  labor  operations  which  were 
machine-paced  under  the  concept  of  constant  work  force. 
Conversely,  the  Teledyne  production  was  labor-intensive 
and  constrained  by  government-imposed  production  rates 


which  w«r«  auch  lower  then  those  of  Magnsvox.  As  s 
result*  for  Nsqnavos*  as  the  average  direct  labor  hours 
decreased*  the  production  rate  rose  as  a  direct  con¬ 
sequence  of  the  constant  work  force.  Thus*  for  Magnavox 
the  production  rate  was  very  sensitive,  exhibited  a  wide 
range*  and  generally  increased  steadily.  Conversely*  for 
Teledyne*  as  the  direct  labor  hours  required  per  equiva¬ 
lent  unit  decreased*  personnel  were  reassigned  to  other 
tasks  so  that  the  constrained  production  rate  would  not  be 
ssceeded.  In  sun*  the  production  rate  would  be  expected 
to  have  different  influences  in  the  two  different  situa¬ 
tions. 

Given  the  differences*  the  logic  of  Model  3  for 
Magnavox  is  listed.  To  a  point*  the  production  rate  at 
Magnavox  generally  increased  steadily  as  the  program 
progressed;  likewise*  to  a  point  the  average  direct  labor 
hours  required  per  equivalent  unit  generally  decreased 
steadily.  Therefore*  the  unit  cost  curve  would  be 
expected  to  be  more  predictive  than  the  cumulative  average 
curve  which  smooths  the  dependent  variable.  Moreover*  the 
smoothed  production  rate  variable  of  Model  3,  when  added 
to  the  presence  of  cumulative  output*  served  to  smooth  the 
relatively  large  changes  in  the  observed  hours  per  unit. 

In  short*  the  unit  coat  curve  was  adjusted  for  midpoints 

e 

to  approach  the  actual  average  cost  of  the*  lots;  once 
these  data  were  augmented  by  a  smoothed  production  rate 
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variable,  the  lagged  effect  (i.e.,  the  cumulative  average 
rate  was  always  smaller  than  the  current  monthly  rate)  was 
just  enough  to  explain  the  relationship  unique  to  Magna- 
vox. 

For  Teledyne,  due  primarily  to  the  production  rate 
constraint  set  by  the  government  and  the  labor-intensive 
nature  of  operation,  expectations  dictated  something 
entirely  different.  Unlike  Magnavox,  the  Teledyne  program 
was  subject  to  fluctuating  production  rates,  and  not 
limited  to  a  generally  steady  movement  in  one  direction. 
These  fluctuations  resulted  from  a  combination  of  factors, 
to  include  comparatively  few  units  produced  per  month  due 
to  government  constraints  and  intermittent  worker 
transfer,  with  its  resultant  interruptions  of  workers' 
continual  familiarity  with  tasks.  In  sum,  a  model  such  as 
Model  5,  whose  dependent  and  X2  independent  variables 
represented  total  monthly  direct  labor  hours  and  monthly 
production  rate,  was  expected  to  predict  well  in  an 
operating  environment  like  that  of  Teledyne  (13:37). 

Similarities 

Two  distinct  similarities  were  noted  between  the 
Magnavox  and  Teledyne  avionics  production  programs.  The 
first  concerned  preproduction  planning  and  its  reflection 
during  data  analysis.  The  second  similarity  revolved 
around  judgment  of  the  appropriateness  of  the  model  being 
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l.«.,  tb«  analysis  of  tbs  rssidual  plots  during 
tbs  Clcst  ccltsclon  tsst  undsc  rsssarch  hypotbssis  ons. 

Ptsproduction  Planning.  Both  Magnavoz  and  Tslsdyns 
plannsd  sxtsnsivsly  prior  to  coounsncinq  full-seals  produc¬ 
tion  of  tbsir  rsspsetivs  avionics  products.  Though  dscid- 
sdly  diffsrsnt  in  tscbnology  and  approach  dus  to  tbs 
inhsrsntly  diffsrsnt  backgrounds  of  tbs  products ,  sach 
sffort  was  obvious. 

Tbs  painstaking  sf forts  of  Magnavox  in  design 
planning  wsrs  discusssd  in  dstail  (2:29-37)  by 
Mr.  Willian  H.  Bodsn,  Program  Director,  UHF  Radios,  of 
Magnavox.  In  tbs  rsfsrsncsd  article,  Mr.  Boden  discusssd 
lifs  cycls  cost  in  tsrms  of  production  design.  Extensive 
prsproduction  design  and  planning  generally  results  in  a 
mors  stable  product  design  throughout  the  production 
phase  by  reducing  the  number  and  severity  of  engineering 
change  proposals.  Thus,  a  great  deal  of  learning  takes 
place  prior  to  the  beginning  of  full  scale  production. 

The  effect  of  this  preproduction  learning  was  reflected  in 
the  Magnavox  data  by  the  character  of  the  rate  of 
learning,  as  viewed  across  a  thirty-nine  month  interval. 

When  preproduction  planning  is  extensive,  a  cumu¬ 
lative  average  cost  curve  is  generally  more  representative, 
at  least  during  the  initial  units  because  the  planning 
serves  to  reduce  the  initial  amount  of  learning.  Chase  and 
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Aquilano  (4:532)  had  tha  following  to  say  about  preproduc¬ 
tion  versus  postproduction  adjustments. 

The  amount  of  learning  shown  by  the  learning  curve 
depends  both  on  the  initial  unit(s)  of  output  and  on 
the  learning  percentage.  If  there  is  much  preproduc¬ 
tion  planning,  experimentation,  and  adjustment,  the 
early  units  will  be  produced  more  rapidily  than  if 
improvements  are  made  after  the  first  few  units — other 
things  being  equal.  In  the  first  case,  therefore,  the 
apparent  learning  will  be  less  than  in  the  second  case, 
even  though  subsequent  "actual"  learning  may  be  the 
same  in  each  instance. 

Thus,  the  Magnavox  situation  was  explained  as  fol¬ 
lows.  The  preproduction  efforts  were  such  that,  although 
a  model  containing  the  cumulative  average  cost  variable 
was  not  the  best  predictosT  the  unit  cost  curve  had  to  be 
augmented  by  a  smoothed  production  rate  variable  to 
approach  accurate  cost  prediction. 

The  effect  of  the  timing  of  adjustments  just 
discussed  was  also  clearly  discernable  in  the  Teledyne 
program.  Although  Teledyne  used  engineering  development 
prior  to  commencing  full-scale  production,  compared  to 
Magnavox  the  rate  of  learning  was  less  in  the  Teledyne 
program.  As  earlier  implied,  this  was  attributable  in 
part  to  the  combined  effects  of  the  government-imposed 
constraints  on  the  production  cate  and  the  labor-intensive 
operations. 

The  rate  of  learning  at  Teledyne  was  also  par¬ 
tially  attributable  to  the  initial  units  of  output,  a  cri- 
terion  just  cited,  and  the  "unconstant"  work  force. 
Contrasted  with  Magnavox,  the  initial  units  of  output  from 
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T«l«dyn«  w«c«  only  a  fraction  as  largo.  Moraovar,  as 
laarning  oceurrad  and  tba  production  rata  inprovad,  it 
approachad  tba  production  constraint.  To  avoid  axcaading 
tba  constraint,  parsonnal  wars  oovad  to  diffarant  tasks. 

Tba  rasult  was  tba  "unconstant"  work  fores,  wbicb  docid- 
adly  affactod  tba  laarning  at  Taladyna.  Spacif ically , 
according  to  Cbasa  and  Aquilano  (4:532),  ”Wa  would  axpact, 
for  axaapla,  that  aora  suparviaors,  rapaiman  and  mats-* 
rial  bandlars  would  spaad  up  production  wbaraas  a  raduc« 
tion  in  tbair  nuabars  would  slow  it  down."  Cbanay  (5:40) 
also  citad  upward  trands  in  costs  (or  toa-ups)  wbicb 
rasultad  froa  tba  transfar  of  axpariancad  paopla  to  dif> 
farant  jobs. 

Tba  coaaon  danoainator  of  tba  preceding  discussion 
was  captured  by  Cbanay  (5:43)  as  follows: 

In  suaaary,  tba  aost  iaportant  raquiremant  in 
using  laarning  curves  as  tools  for  production  cost 
astiaating  (or  for  any  otbar  purpose)  is  that  the  esti- 
aator  be  thoroughly  faailiar  not  only  with  learning 
theory,  but  also  with  all  pertinent  aspects  of  the 
particular  industry  to  which  be  is  applying  learning 
theory. 

To  this  should  be  added  that  the  astiaator  must  also  be 
constantly  aware  of  variations  within  a  particular 
industry — both  firas  and  products. 

Analysis  of  Residuals.  Common  to  both  data  sets, 
of  course,  was  the  subjective  analysis  of  residuals. 
Precautions  ware  taken  not  to  overlook  any  implications  of 
these  analyses.  Such  oversight  is  not  uncomaon,  according 
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to  Spucr  and  Bonini.  (22:607),  when  computer  analysis  pack¬ 
ages  ace  becoming  more  and  more  numerous. 

Por  some  models,  the  patterns  in  the  residuals 
were  clearly  unacceptable,  e.g.,  obvious  heteroscedastic- 
ity.  In  still  other  analyses  the  subjective  calls  were 
close.  Several  possible  reasons  were  considered  for  the 
unacceptable  patterns  in  residuals.  Those  reasons  include 
inadequate  collection  and  recording  of  production  data,  as 
described  by  Cochran  (6:435-437)  and  Johnson  (13:34). 

Other  possible  reasons  were  management  control  and  self- 
fulfilling  prophecy  (9:17-23),  and  the  possJ.bility  of 
linear  regression  not  being  adequately  representative 
(5:56)  . 

The  most  likely  reason  for  the  patterns  was  con¬ 
cluded  to  be  within  the  margin  between  linearity  and  the 
best  possible  model,  i.e.,  some  quadratic  regression.  The 
issue  of  linearity  was  cited  early  in  this  paper  as  being 
beyond  the  scope  of  this  research.  It  remained  beyond  the 
scope,  although  the  authors  were  compelled  to  make  some 
observations.  According  to  Cheney  (5:56),  the  issue  of 
linearity  is  no  longer  considered  important  because 
learning  curves  are  only  approximations.  Cheney  (5:56) 
also  reported  Asher's  opinion  of  1956  that  in  each  specific 
case  it  is  judgment  that  determines  whether  or  not  a 
linear  curve  is  appropriate.  Beyond  that,*  in  the  authors' 
opinions,  the  judgment,  in  turn,  must  necessarily  be  based 
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on,  oc  at  least  be  Influenced  by,  the  pucpoae  of  the 
research  and  the  inherent  tradeoffs. 

Cheney  (5:56)  cited  Barrett,  whose  1969  Ph.O. 
dissertation  was  an  empirical  study  of  learning  curves 
which  led  him  to  the  following  two  conclusions.  First, 
generally  there  was  one  or  more  nonlinear  forms  which 
better  fit  the  data  set  than  did  the  linear  form.  Second, 
there  was  for  each  user  or  investigator  a  tradeoff  between 
the  sacrificed  accuracy  of  simple  linearity  and  the  cost 
of  increased  accuracy  associated  with  hypotheses  about 
nonlinearity. 

Due  to  the  purpose  of  this  research  and  the 
inherent  tradeoffs,  some  avenues  were  not  comprehensively 
explored.  Ex2unples  of  these  avenues  were  as  follows: 

1.  Displacement  of  autocorrelation  schemes,  as 
discussed  by  Meter  and  Wasserman  (17:352~366) .  Autocor¬ 
relation  probably  existed  to  some  degree  in  all  models 
tested,  especially  in  Model  5  which  was  taken  from  Johnson 
who  reported  autocorrelation  (13:38-39).  Consequently, 
while  Teledyne  Model  5  passed  all  the  tests  and  was 
excellent  or  good  in  predictive  ability,  the  standard 
error  of  the  estimate  may  well  be  low  (13:38).  The  issue 
of  autocorrelation  assumes  even  greater  importance  for 
those  who,  like  Johnson  (13:38),  view  the  cumulative  out- 
put  variable  as  a  proxy  for  time. 
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2.  Variance-stabilizing  transformations,  as 
discussed  by  Neter  and  Wasserman  (17:131-136).  All  models 
which  were  rejected  during  analysis  of  the  residuals 
(Criterion  Test  One  (A)]  were  found  unacceptable  due  to 
obvious  heteroscedasticity.  Each  rejection  was  based  on 
careful  analysis,  to  include  comparisons  with  Neter  and 
Wasserman 's  prototype  residual  plots  (17:101). 

3.  F  test  for  linearity  (17:113-121).  Each 
rejection  based  on  subjective  evaluation  of  residuals  can 
be  tested  statistically  through  the  F  test  for  linearity. 

In  conclusion,  there  was  a  tradeoff  in  this 
research  between  improved  but  unneeded  accuracy  and  the 
convenience  of  linearity.  The  subjective  analysis  of 
residuals  caused  rejection  of  several  models  due  to  inap¬ 
propriateness.  Those  models  which  were  acceptable,  how¬ 
ever,  were  distinguished  by  two  features.  First,  they  had 
already  passed  all  statistical  tests  under  research 
hypothesis  one.  Second,  they  also  included  models  whose 
predictive  abilities  were  good  enough  under  research 
hypothesis  two  to  meet  the  objectives  of  this  research. 

Summary 

The  preceding  analyses  of  the  two  avionics  produc¬ 
tion  programs  were  based  on  the  methodology  and  treatment 
of  data  as  earlier  explained  in  Chapter  III.  For  both 
data  sets,  Magnavox  and  Teledyne,  research  hypothesis  one 
was  accepted.  Analysis  of  the  data  revealed  that 
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production  rat*  waa  an  Important  •xplalncr  of  variation  in 
direct  labor  hours  for  nin*  of  th*  t*n  models  evaluated. 
Had  the  statistical  testa  been  at  the  0.06  level  of  signi¬ 
ficance  »  all  ten  models  tiould  have  confirmed  production 
rat*  as  an  important  explainer  of  the  variation.  More¬ 
over,  in  seven  out  of  ten  models  tested  under  research 
hypothesis  one,  th*  increase  in  (actual)  was  9  percent 
or  more  once  cumulative  output  was  augmented  by  the  pro¬ 
duction  rate;  in  half  of  the  models  the  increase  in 
R^  actual  was  30  percent  or  more.  The  summary  statistics 
for  r2  (actual)  are  found  in  Table  16. 

For  both  data  sets,  Magnavox  and  Teledyne, 
research  hypothesis  two  was  accepted.  Mot  only  was  th* 
increased  predictive  ability  of  th*  full  model  statisti¬ 
cally  higher  when  tested  at  the  0.05  level  of  signifi¬ 
cance,  but  th*  subjective  tests  also  clearly  demonstrated 
the  superiority  of  the  full  model. 

For  th*  overwhelming  majority  of  all  test  situa¬ 
tions,  the  inclusion  of  the  production  rate  variable 
served  to  stabilize  the  predictions  when  they  were  over  a 
long  time  span.  This  finding  supported  Congleton  and 
Hinton's  research  (8:83),  as  well  as  Smith's  findings 
(21:136) .  Xn  other  words,  the  full  model  not  only  pre¬ 
dicted  better  over  th*  eighteen  month  time  span,  but  its 
predictions  were  also  far  leas  susceptible'  to  loss  of  pre¬ 
cision  as  data  points  were  truncated.  Still  another 
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TABLE  16 

INCREASES  IN  r2  (ACTUAL)  FOR  ALL  TEN  MODELS  TESTED 
AFTER  INCLUSION  OP  PRODUCTION  RATE 


r2 

Modtl  R«duc«<!l 


r2 

Full  Ar2 


Magnavox 

1 

48.0 

Magnavox 

2 

81.6 

Magnavox 

3 

48.2 

Magnavox 

4 

81.6 

Magnavox 

5 

2.2 

Teledyna 

1 

7.3 

Taledyna 

2 

95.5 

Taladyne 

3 

7.3 

Teladyne 

4 

95.5 

Teledyne 

5 

23.5 

57.0 

82.8 

95.0 

96.5 

56.7 
43.3 

96.2 

50.2 

96.8 
98.1 


1.2 

46.8 

14.9 

54.5 
36.0 

0.7 

42.9 
1.3 

74.6 
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finding  va«  that  tha  tcand  obaarvad  in  tha  raducad  modal 
to  conaiitantly  ovaraatiaata  tha  caquirad  diract  labor 
houca  aaa  aliainatad  onca  production  rata  waa  addad  to  tha 
raducad  aodal. 

Anothar  obaarvatlon  concarnad  tha  aanaitivity  of 
tha  ragraaaion  coafficianta  to  changa  aa  obaarvatlona  wara 
truncatad  and  naw  ragraaaion  coafficianta  wara  computad, 
aa  daacribad  in  Chaptar  ZV.  Thaaa  raaulta  indicatad  that 
avan  within  a  particular  production  program,  tha  coaf> 
ficianta  wara  aanaitiva.  This  sanaitivity  suggaats  that 
tha  davalopmant  of  ganaral  coat  modala  uaing  coafficianta 
darivad  from  aavaral  avionics  production  programs  is 
inappropriata. 

Both  tha  statistical  and  subjactiva  rasaarch  find¬ 
ings  varifiad  tha  applicability  of  tha  cumulative  produc¬ 
tion  and  production  rata  modal  to  tha  two  subject  avionics 
production  programs,  tha  potential  overall  application  of 
this  modal  provokes  even  more  interest  whan  one  recognizes 
tha  vast  difference  in  the  environments  of  the  two  subject 
programs,  as  daacribad  at  tha  beginning  of  section  three  of 
this  chaptar.  That  interest  is  provoked  despite  tha  inabi¬ 
lity  to  generalize  tha  findings  beyond  tha  Magnavox  and 
Taladyna  data. 
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CHAPTER  V 


SUMMARY,  CONCLUSIONS  AND  RECOMMENDATIONS 

Since  the  late  1960s  cost  growth  has  become  an 
increasingly  stronger  concern  of  the  Air  Force  community. 
Nowhere  has  this  strengthened  concern  become  more  visible 
than  in  the  acquisition  sector,  especially  in  connection 
with  the  acquisition  of  major  systems.  Avionics  com¬ 
ponents  are  often  a  part  of  a  major  system  where  costs 
grow  rapidly;  therefore,  cost  estimating  assumes  great 
importance. 

A  key  cost  element  is  that  of  direct  labor. 

Because  other  costs,  to  include  an  overhead  charge,  are 
pyramided  on  it,  the  direct  labor  cost  is  a  crucial  ele¬ 
ment  is  cost  estimating.  Costs  for  direct  labor  are  fre¬ 
quently  estimated  by  use  of  a  learning  curve  model. 

Literature  Review 

Learning  curve  models  have  served  as  techniques 
for  estimating  direct  labor  costs  for  at  least  fifty 
years,  but  they  do  not  systematically  consider  the 
effects  of  production  rate  on  direct  labor  costs.  In 
fact,  learning  curve  models  do  not  consider  production 
rate  at  all,  much  less  the  exogenous  changes  in  that  rate. 
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Y«t  th«  axo^cnous  changes  do  occur,  as  avldancsd  In  this 
rasaarch  by  tha  govarnaant  iapoaad  constraints  on 
Taladyna.  Failing  to  conaidar  tha  production  rata 
changes  does  not  aaka  sense.  For  example,  as  Johnson 
(13:25)  noted,  tha  learning  curve  modal  would  predict  tha 
same  labor  hour  requirements  Cor  1,000  widgets,  regard¬ 
less  of  whether  the  production  rate  was  100  per  month  or 
10  per  month. 

Investigations  of  the  eCfects  of  introduction  of 
the  production  rate  variable  into  a  learning  curve  model 
have  a  long,  controversial  history.  Some  investigators 
have  rejected  the  significance  of  the  production  rate. 
Such  rejection  has  usually  been  at  least  partially  based 
on  statistical  testing.  Other  investigators  have 
demonstrated  that  the  production  rate  is  in  fact  a  sig¬ 
nificant  explainer.  During  the  past  ten  years,  these 
latter  investigations  have  resulted  in  compatible  find¬ 
ings  about  the  production  rate  in  airframe  manufac¬ 
turing.  It  was  the  compatibility  of  these  findings 
attesting  to  the  significance  of  production  rate  in 
airframe  manufacturing  that  formed  the  basis  for  this 
research.  Based  on  Smith's  model,  this  research  extended 
the  investigation  of  production  rate  from  airframes  to 
avionics. 
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Th«  Mod<l 


Smith's  modsl  was  davalopad  savaral  years  ago  and 
later  replicated  by  Congleton  and  Kinton.  It  is  an  adap¬ 
tation  of  Orsini's  model  and  the  full  model  is  as 
follows : 

Y  ■  Bq  • 

where*  in  general  terms*  the  variables  are  defined  as 
follows: 

Y  represents  the  direct  labor  hours* 

Xx  represents  the  cumulative  output  variable* 

and 

X2  represents  the  production  rate  variable. 

Transformed  to  logarithmic  terms*  the  full  model  becomes 

Log  Y  •  Log  Bq  +  Log  +  Bj  Log  Xj  ■*'  e. 

The  reduced  model  is  identical  to  the  full  model*  before 
and  after  transformation*  except  the  reduced  model  does 
not  include  the  second  independent  variable*  production 
rate.  In  other  words*  the  reduced  model  is  a  learning 
curve  model.  Specific  arrangements  of  variables  and 
treatment  of  the  raw  data  sets  in  this  research  were 
discussed  in  Chapter  III. 
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R««€«rch  Oblactiy 

This  r«s«arch  had  two  caaaaEch  objactivca.  Th« 
first  was  to  data rains  if  tbara  was  an  affact  by 
production  rata  cbangas  on  production  diract  labor 
raquiramants  for  avionics  production..  Tba  sacond  objac- 
tiva  was  to  avaluata  tba  pradictiva  ability  of  tba  full 
iBodal,  ones  it  was  tailorad  to  a  particular  avionics  pro¬ 
duction  program,  for  aightaan  months  into  tba  future. 

Mathodoloqy 

Tba  matbodology  for  this  resaarch  was  canterad  on 
aultipla  linaar  ragrassion  analysis,  given  transformation 
of  tba  modal,  just  axplainad,  and  traatmant  of  the  data 
sata.  Savaral  staps  comprised  tba  total  raquiramants  a 
modal  bad  to  mast  to  transit  through  tba  antira  metho¬ 
dology. 

Rasaarcb  bypothasis  one  stated  that  production 
rata  was  an  important  explainer  of  diract  labor  hours  whan 
included  in  an  appropriate  modal.  First,  the  F  test  was 
used  to  ehack  for  a  relationship  of  the  dependant 
variable,  diract  labor  hours,  to  tba  sat  of  independent 
variables,  cumulative  output  and  production  rate.  This 
check  constituted  statistical  test  one  (A) .  Statistical 
test  one  (B) ,  on  tba  other  hand,  was  used  to  test  the  pro¬ 
duction  rata  (B2)  coefficient  for  significance. 

Following  tba  statistical  tests,  two  criterion 
tests  ware  used  under  the  first  research  bypothasis.  The 
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first  criterion  test  was  used  to  evaluate  and  accept  or 
fail  to  accept  the  residuals  from  regression  analysis. 

The  second  criterion  test  required  both  and  (actual) 
to  exceed  85  percent,  an  arbitrary  figure  based  on  the 
experience  of  the  authors.  All  models  passing  both  sta¬ 
tistical  tests  and  both  criterion  tests  were  then  tested 
under  research  hypothesis  two. 

Research  hypothesis  two  was  that  for  eighteen 
months  into  the  future  the  full  model  was  a  better  predic¬ 
tor  than  the  reduced  model.  The  comparative  predictive 
abilities  of  the  models,  full  and  reduced,  were  evaluated 
both  statistically  and  subjectively  against  the  observed 
values.  This  evaluation  was  made  possible  by  using  the 
same  truncation  and  simulation  procedure  that  Smith  used. 
Statistical  test  two  then  compared  the  average  absolute 
deviations  of  the  full  versus  reduced  models  over  an 
eighteen  month  interval.  The  subjective  test,  on  the 
other  hand,  compared  predictions  of  both  models,  full  and 
reduced,  with  the  observed  values  and  the  deviations  in 
this  case  were  classified  into  categories  of  good  and 
excellent.  Thus,  the  criterion  test  two  results  from  the 
subjective  comparisons  landed  a  measure  of  practicability 
to  the  research. 

Excepting  analysis  of  residuals,  all  test  results 
were  achieved  through  use  of  the  computer  program  PRODRATE 
which  is  listed  and  described  in  Appendix  A.  PRODRATE  is 
a  modified  version  of  the  Fortran  IV  program  used  by 
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Smith.  A  sample  computer  run  of  the  entire  PRODRATE 
program  is  also  included  in  Appendix  A.  The  data  set  for 
this  sample  is  an  artifeial  set  and  both  selection  options 
are  illujtrated. 

Conclusions 

The  objectives  of  this  research  were  achieved. 
Production  rate  was  found  to  be  a  significant  explainer 
of  variation  in  direct  labor  hours  in  nine  of  ten  cases. 
Bad  the  statistical  testa  been  at  the  0.06  level  of  signi¬ 
ficance,  the  test  cases  would  have  unanimously  supported 
the  first  research  hypothesis.  The  predictive  ability  of 
the  full  model  was  better  than  that  of  the  reduced  model 
for  eighteen  months  into  the  future.  That  superiority  was 
supported  statistically  by  measuring  the  average  absolute 
deviations  over  an  eighteen  month  interval  in  which  324 
teat  situations  were  evaluated.  Superiority  was  also  sup¬ 
ported  in  subjective  tests. 

Zn  addition  to  the  research  objectives,  per  se, 
leading  to  the  two  prime  conclusions,  several  additional 
conclusions  resulted  from  this  research.  Bach  of  these 
additional  conclusions  will  be  discussed  in  turn  as  they 
appear;  then  corollary  findings  and  recommendations  will 
close  this  paper. 

e 

e 

First  Additional  Conclusion.  The  addition  of  the 
production  rate  variable  to  the  learning  curve  model  had 
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d«sicabl«  affects  other  than  those  directly  anticipated  as 
results  of  the  two  research  objectives.  The  two  which 
followed  from  the  research  objectives  were  just  listed. 
Other  conclusions  were  reached,  beginning  with  what  might 
be  termed  "stability.” 

Whereas  the  learning  curve  model  consistently 
overestimated  the  direct  labor  hours  requirements,  the 
full  model  did  not.  Thus,  just  as  Smith  found,  this 
research  found  that  the  production  rate,  when  included  in 
an  appropriate  model,  stabilized  the  predictions  over  an 
extended  interval.  This  finding  alone,  without  regard  to 
statistical  tests  of  explained  variation  and  predictive 
ability,  indicates  that  inclusion  of  production  rate  (at 
least  in  the  programs  evaluated  by  this  research)  leads  to 
more  accurate  projections  of  direct  labor  hours  require¬ 
ments  . 


Second  Additional  Conclusion.  The  results  of  this 
research  clearly  indicate  that  the  objectives  were  met; 
however,  at  the  same  time,  another  obvious  conclusion  is 
that  the  regression  coefficients  are  unique  to  the  program 
for  which  they  were  derived.  This  uniqueness  holds  for 
the  Magnavox  coefficients  for  that  program,  and  it  holds 
for  the  Teledyne  coefficients  for  the  Teledyne  program. 

e 

That  obvious  conclusion  was  consistently  evidenced  during 
simulations  of  predicting  the  future,  using  the  truncation 
method  described  in  Chapter  III.  During  those  truncations. 
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Corollary  Findings.  Several  corollary  findings 


were  considered  for  inclusion  in  this  research.  Along  the 
way  it  was  very  tempting  to  go  off  on  tangents  and  inves¬ 
tigate  some  other  interesting  topics.  Examples  included 
the  issues  associated  with  residual  analysis  (e.g.,  auto¬ 
correlation  and  homoscedasticity) ,  multicollinear ity,  pat¬ 
terns  of  regression  coefficients,  cumulative  average  ver¬ 
sus  unit  curves,  learning  curve  versus  the  experience  or 
improvement  curve,  and  nonlinear  regression  analysis.  As 
the  research  progressed,  it  became  evident  that  there  were 
limits  to  what  could  be  achieved.  Consequently,  only  two 
corollary  findings  were  written.  Listed  as  PRODRATE  and 
multicollinear ity ,  in  the  appendixes  to  this  research ,' the 
two  corollary  findings  were  included  with  the  intent  of 
providing  findings  which  would  be  of  the  most  practical 
value  to  the  readers,  the  price  analysts,  and  future 
researchers . 

Recommendations 

The  most  obvious  recommendation  is  listed  first. 

Not  only  can  Smith's  model  be  used  in  the  ongoing  programs 
which  were  evaluated  during  this  research,  but  the  model 
should  be  tested  within  other  ongoing  programs  of  avionics 
production. 

All  sorts  of  possibilities  are  open  in  avionics  for 
the  aggressive  researchers  who  want  to  link  production 
rate  to  other  cost  elements.  For  example,  the  level  of 
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•ggetgation  of  coats  (comparable  to  Smith's  fabrication, 
assembly,  and  total  hours  in  airframes)  in  avionics 
appears  untouched.  Another  interesting  twist,  alluded  to 
in  Chapter  III,  is  the  direct  labor  versus  total  costs. 
Still  another  approach  could  address  the  direct  manufac¬ 
turing  labor  hours  versus  all  direct  labor,  as  discussed 
by  Johnson  (13:26). 

In  final  conclusion,  then,  the  cumulative  produc¬ 
tion  and  production  rate  model  as  developed  by  Smith 
appears  worthy  of  even  further  application  within  avionics 
production  and  attempted  extensions  elsewhere.  The 
authors  believe  that  future  researchers  have  an  area  open 
to  them  limited  only  by  their  ingenuity  in  recombining  the 
raw  data  of  a  particular  production  program. 


This  appendix  is  made  up  of  three  sections.  The 
first  section  describes  how  the  program  works  and  what  it 
does.  The  second  section  lists  the  computer  program 
PRODRATE  in  its  entirety.  Finally,  there  is  a  sample  out> 
put,  to  include  both  selective  options  described  in  sec¬ 
tion  one  of  this  appendix.  The  output  in  section  three 
comes  from  an  artificial  data  base. 

A  Description  of  the  Computer 
Program  PRODRATE 

Upon  beginning  this  research,  the  authors  were  at 
first  overwhelmed  at  the  variety  and  complexity  of  the  com¬ 
puter  programs  available  for  multiple  linear  regression 
analysis.  The  majority  of  these  programs  converted  the 
input  variables  to  logarithms  prior  to  regressions.  A  few 
computer  programs  were  available  which  conducted  nonlinear 
regression  directly  through  an  iterative  process.  None  of 
the  available  programs  were  ideally  suited  for  this 
research,  however,  because  the  authors  wished  to  look  at 
the  predictive  ability  of  the  full  and  reduced  models  in 
addition  to  the  regression  results. 

The  computer  program  written  by  Smith  (21:147-153) 


for  his  research  came  very  close  to  meeting  the  needs  of 

e 

the  authors;  but  some  modifications  were  necessary  to  pro¬ 
vide  for  the  predictive  ability  tests.  In  addition. 


Smith's  program  had  bean  loaded  into  the  COPPER  IMPACT 
computer  aystem^^  but  had  not  been  debugged  and  made 
operational.  Thus,  with  Smith's  permission,  the  authors 
decided  to  modify  his  program,  rather  than  construct  an 
entirely  new  program. 

The  primary  objective  of  this  modification  was  to 
make  the  interactive  program  available  on  COPPER  IMPACT  as 
an  additional  tool  for  cost  comparison.  A  secondary 
objective  was  to  format  the  computer  output  to  make  it 
easy  to  read  and  facilitate  comparisons  between  the  full 
and  reduced  models.  The  program  PRODRATE,  listed  in  this 
appendix,  was  the  result  of  the  modification. 

To  make  this  program  accessible  to  the  government 
cost  and  price  analysts,  PRODRATE  has  been  included  in 
the  COPPER  IMPACT  library. 

The  program  reads  the  input  data  from  any  file 
specified  by  the  user.  Instructions  on  how  to  build  a 
data  file  are  available  In  the  program.  This  feature 
allows  the  user  to  change  the  form  of  the  model  (e.g., 
unit  curve,  cumulative  curve,  total  coat  curve)  simply  by 

14copper  impact  is  the  project  name  of  an  aggres* 
sive  program  to  Improve  Modern  Pricing  ^d  Coating  Tech¬ 
niques  used  in  tEe  Air  Force  contracting  process,  ^hia 
program  emphasizes  the  implementation  of  advanced  computer 
techniques  applied  to  price  and  cost  analysis  and  the 
training  of  Air  Force  personnel  in  the  skillful  use  of 
these  techniques  (25:1).  The  time-sharing 'computer  system 
is  designated  by  the  same  name,  COPPER  IMPACT,  and  is 
government-leased,  currently  from  General  Electric. 
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maicing  the  necessary  modifications  to  the  data  base.  In 
addition,  an  option  within  the  program  allows  the  user  to 
list  the  input  data  as  they  were  read  from  the  data  file 
and  converted  to  logarithms. 

Analysis  of  the  data  is  begun  by  calculating  and 
printing  the  Pearson  correlation  coefficients  of  the 
three  variables:  direct  labor  requirements,  cumulative 
production,  and  production  rate.  Log-linear  regression 
is  first  performed  between  the  direct  labor  requirements 
(dependent)  variable  and  the  cumulative  production 
(independent)  variable.  Finally  the  dependent  variable 
is  regressed  against  both  Independent  variables  simul¬ 
taneously. 

In  presenting  the  results  of  each  of  these  three 
regressions,  the  program  prints  a  listing  of  the  actual 
direct  labor  requirements,  the  predicted  direct  labor 
requirements,  and  the  residuals.  This  feature  of 
PRODRATE  is  one  the  authors  found  unavailable  elsewhere. 
The  obvious  advantage  is  that  the  user  can  relate  the 
results  to  the  original  untransformed  variables  (rational 
numbers,  not  logarithms)  and  see  how  well  the  untrans¬ 
formed  data  fit  the  model. 

Following  the  listing  of  the  residuals,  summary 
statistics  are  printed  for  each  model.  They  include  the 

e 

values  for  the  coefficients  (exponents),  standard  errors, 
F  ratios,  r2,  r2  (actual),  and  learning  factor.  Two 
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s«I«ctlv«  options  for  which  sdditionsl  printouts  are 
swailsbls  ara  tha  Pradictiva  Ability  Tasts  and  tha 
Projaction  and  Sansitivity  Matrix.  For  a  quick-looic  anal¬ 
ysis  of  savaral  diffarant  modals,  tha  program  can  ba 
prasat  to  stop  aftar  thraa  ragrassion  analysas  by  not 
salacting  tha  additional  options. 

Tha  Pradictiva  Ability  Tast  option  parmits  tha 
usar  to  salact  tha  number  of  data  points  (casas)  to  ba 
truncatad  during  tha  tast  and  thus,  control  tha  time  span 
over  which  tha  tast  is  conductad.  Tha  tast  is  parformad 
using  nastad  00  loops  to  perform  a  stapwisa  truncation  of 
tha  data  points.  Tha  truncatad  data  is  then  predicted 
using  tha  ragrassion  results  of  tha  remaining  data. 

Aftar  all  truncatad  cases  have  bean  predicted  and  results 
printed,  a  summary  table  is  printed.  This  summary  table 
contains  data  on  statistical  significance  and  parmits 
subjective  comparisons  of  tha  accuracy  of  predictions 
made  by  the  full  and  reduced  models.  This  process  is 
described  in  Chapter  XV  just  prior  to  tha  presentation  of 
predictive  ability  test  results  for  tha  Magnavox  Modal  3. 
In  addition,  an  example  is  provided  in  section  three  of 
this  appendix. 

Tha  Projaction  and  Sensitivity  Matrix  option  of 
program  PROORATE  provides  tha  cost  and  pri^e  analyst  with 
a  means  of  predicting  direct  labor  ragulramants  at  varying 
production  rates.  This  option  also  parmits  tha  usar 
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to  s«e  the  sensitivity  of  the  direct  labor  requirements 
to  changes  in  production  rate  over  a  wide  range  of  cumu¬ 
lative  production.  The  last  observed  values  for  cumula¬ 
tive  production  and  production  rate  are  used  as  the 
starting  point  for  this  projection.  The  cumulative  pro¬ 
duction  variable  is  increased  by  increments  of  1  per¬ 
cent  of  the  last  observed  value,  while  the  production 
rate  variable  begins  at  70  percent  of  the  last  observed 
value  and  is  increased  by  10  percent  increments  until  it 
reaches  150  percent  of  the  last  observed  value. 

These  projections  are  printed  in  matrix  form  with 
the  projected  production  rates  printed  across  the  top  of 
the  matrix  and  the  projected  cumulative  production  plot 
points  printed  along  the  left  margin  of  the  matrix. 
Projected  direct  labor  requirements  can  then  be  read 
directly  from  the  matrix  by  matching  a  given  production 
rate  with  a  given  number  of  cumulative  units.  The  value 
for  direct  labor  requirements  is  found  at  the  intersec¬ 
tion  of  the  corresponding  row  and  column. 

In  summary,  therefore,  the  program  PRODRATE  is  a 
modified  version  of  Smith's  FORTRAN  IV  program.  Like 
Smith's  program,  PRODRATE  converts  the  input  data  to 
logarithms  prior  to  regression.  In  addition,  PRODRATE 
permits  the  user  to  automatically  receive  or  decline 

e 

either  or  both  of  the  options  for  Predictive  Ability 
Tests  and  Projection  and  Sensitivity  Matrices.  For  the 
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analyst  who  is  accuatomsd  to  working  with  the  learning 
curve  aodel,  the  program  PRODRATE  quickly  shows  whether 
the  production  rate  variable  is  significant  and  the 
effect  it  has  on  estimating  direct  labor  requirements. 
The  authors  believe  the  program  PRODRATE  can  be  a  very 
useful  tool  for  the  government  cost  and  price  analyst. 


Section  2 


This  section  lists  the  computer  program  PRODRATE 
in  its  entirety.  In  addition  to  the  modifications  which 
were  thoroughly  described  in  the  preceding  section,  great 
care  was  taken  to  document  the  modified  program.  The 
intent  of  the  documentation  (i.e.,  comment  lines)  was  to 
make  it  easier  for  the  user  to  follow  particular  parts  of 
the  program. 
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)tH  uiT  •  (swiii-suutiSflir/icAStsi/$8r((Ssxi-(9mtMz/iicAscsn«($ST-<siiiTMzmsESin 

}tif  im  >  (saRm-$anz*$iRiT/iiusc5)/$aiTi(S3n*(sauH2/icASES)i«($sr-(suiiTH2/iicASESiii 

)va  niu  •  (9aii{-$aini«nz;icisui/$wT((ss:t-(suniH:/RCAScs)i«(s$iz-<SfliiZHZ/iicxsESiii 

3t»  UtXl  >  1.1 

»M  um  •  i.f 

nSI  ITT  >  1.1 

itM  niiT  n.in.uiT.im.«x;T.uui.nia.HnfMia.mR 

3171  71  F(SIMT(lIi///.lI.43(*>'t./>4Xi'nMSn  COnEUTin  CQEFFICIEKTS  *i 

3tm  n«T«ix*i/iii.4sr*-,,//,*i,-»*,ji,-f.*ir**-,3x.*xi*.ni‘**,ni 

3iT«  tri/iix.4jcn,/,aiT.3Xi3<*»  •.fii.7iixi./.ixi«ci*i,/,a, 

3ZNI  Ti’.a.xri  •.«i.7iix)./iiXi4Si*i-),/,af*!rtai3r»  •rfii.7iix).////i 

3ai  rair  7( 

3Z3IC  CHaUTE  Ml  nilT  TK  (ECtCSin  lESUin  OF  THE  CTARMIB  lEMlIMC  CURVE  HOKL 

3ZM  It  •(9RlT-((»nt*«IRWIKttaiWl$SXMSBllMaiC9SESll 

3ZM  TIM  •  Stm/KISES 

309  HBMt  >  SBMS/HCISCS 

3ZM  HIM  •  SOni/lCISES 

3zn  UM  *  Sunu/KMCS 

33N  n  •  TM-  lltllM 

3311  AM  «  If.HN 

3Sf  n»T  73 

3331  73  FqRmT(lIi;3Cn>7il4li*RES«.T3  «  TIC  STAiOMI  lEAmiK'i 

334M  •  cmVE  l«IIEL*./*lXi73Ci*),/,iX."CASP.3X.’9ISEWEa*.ni*FRaitTEri 

333K  3Xi*«ESigUAL*i3Xin  OEVlATIOn 

33M  N  111  I<tilCASES 

3371  TTMIL  >  N  »  II  *  Utl) 

33M  RESIX  <  Til)  •  THATl 

33M  SSEU  >  SSai  *  SSIX  h  Z 

34M  SSTOlt  •  SSnu  *  (Til)  •  TM)  tt  Z 

34tf  THAT  >  II  H  TMTI 

34ZI  KSIO  >  WSII)  •  THAT 

3431  PERCar*  IRESH  /  l«S(I)l  4  m 

3441  SSEl  •  SSEl  4  AESIO  •«  Z 

3431  SSTOl  •  OTOt  4  (NRSII)  -  HRSMI  h  Z 

3441  raiRT  WtliMSintlHATilESlOtFERCEIlT 

3471  N  F0RMT(lXil3i4XiFI.Zi4XiFI.Zi3XiFI.Zinin.a 

34N  111  CnTlHIE 

33IIC  CALCULATE  AM  PRIRT  STATISTICS  FOR  THE  STAMMB  LEAMUC  CURVE  ROKL* 
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IDfO  •  NCASCS  •  t 
TKKL  •  (SSIOII  •  SSail 

THsa  >  ssai  /  non) 

SCE  <  9UT  (THSELI 

VMSI  •  SEE  /  (1  /  ICASES  *  IIBM  *K  /  (SSIt  -  (SUMl  «*  t  I  BCASESII) 

SEll  >  SWT  (VMMI 

SE81  >  SEE  /  (SWT(SSX1*(SU)|I1hE/IICASESI)I 
RS«.l  «  (SST(Il.l  -  SSB.U  I  SSTOLl 
Rsut  >  (ssToi-  ssEi)  /  ssroi 
mrio>  tusrl  /  msa 

PlEAm<  (II  ti  (It  4  IK.()Ctf(2,f))l  •  IN 

PRINT  8IiN>SESitAEIi8tiSEBl>RSaLtiSEEiTIISEL>TNSRLiPRATI0.M)FIl.RSMl.PtiMN 
SI  F0RNAT(lIi7S(‘n,/,ll,*ri(E  EVMTION  FOR  THIS  MOEL  IS:  ‘i 
’  THAT  >  M  «  II  M  ll’i/illi 

*IN  LOC  FORK  THIS  KDEL  BECQHES:  LOCITHATl  >  LOCdll  *  II  i  LOCdll’i 

/fII."llH£R£!  LOCdll  «*.F8.3,4I."ST0  ERROR  «*,F8.5i«i*SI  •"tFII.Si 

/il3Ii*8l  =*tF8.3t4I.*STll  ERROR  ••,F8.3i 

/iIXt"SW«ART  STATISTICS:‘!/iIXi 

•R  SWIAREB  LOC  «*iF7.3tlHi*STD  ERROR  EST  «*.FlI.4i/.lX. 

•|(SEM3Xi”«*fF?.3f3Xi"RSR"iIII."»”,F?.3f/flXi 

f  RATI0*i9Xf*>*.F8.4i3Ii*0.  F.  (N/OI  •  t/*iI3iMXi 

‘R  SCIMREO  ACTUAL>*>F7.3<8X.1EARNINC  FACTOR  <'>F8.3*'  PERCENT*. 

/.lX.TSCni 

PRINT  71 

ts:;'.:!!;:;:".;v.::;5:5s;!:!;i'.:;;5;s;;s:ss8s:s55s;;s:s!i::!;;:j! I :::::: 
CALCIJUTE  ANO  PRINT  THE  RECRE3SI0N  RESULTS  FOR  THE  REDUCED  HRS  VS  RATE  HODEL 


K  >(SUNIZT-((SURX2«SUNTI/NCAS£SII/(SSXZ-(SURX2«K/NCASESI I 
81  <  TEAR  •  8Z  t  IZBAR 
All>  II  H  81 
PRINT  8Z 

8Z  F0RIIAT(IX.73("i*)./.IIX. “RESULTS  OF  RECRESSION  ON  PROOOCTlOr, 

■  RATE  VARIABLE  ALflRE*./.lX.73(**"I.7.lI.“CASE’.3X.*OBSERVED*.3X. 
•PREBIC7ED“.SX."R£SIBUAL*.3X.“l  DEVIATION*! 

DO  III  I'tiNCASES 
THATL  <  M  4  8Z  4  IZdl 
RESIOL  >  KII  •  THATL 
SSEU  >  SSEU  4  RESIDL  442 
SSTOU  >  SST0L2  4  (Tdl  -  dARl  M  2 
THAT  •  II  H  THATL 
RESID  •  HRSdl  •  THAT 
PERCENT*  (RESID  7  HRSdl)  4  IN 
SSa  •  SSEZ  4  RESID  442 
SST02  >  SST02  4  (|«Sd)  -  HRSDARI  44  l 
PRINT  Nil.HRSdl.THAT.RESID.PCRCraT 
III  CONTINUE 

CALCUUTE  ANO  PRINT  STATISTICS  FOR  THE  REDUCED  HRS  VS  RATE  NOOa 
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4fM  nsn  *  mrou  •  sssna 

wa  rasa  •  ssaz  i  an 

tm  SEE  •  S«T(TKEU 

4M«  MW  •  SEE  /  (1  /  nttSES  *  OIM  H  {  /  (SStt  •  iSOlU  h  1 1  KISESItl 
iMf  SM  t  SQitT  (VMMi 

4fM  SEK  •  SEE  /  (SORT  (SSU  •  (SORK  m  {  t  KISEStll 

<171  noz  •  (ssnu  •  sselu  t  ssnu 

tm  tsut  •  (SSTK<  SSEn  /  SSTQE 

4M  FMTio*  rasa  /  rasa 

4IM  mar  n*Mf$EM>Mi>KiSEK>iissu<SEE>rasatrasaifMTUiMiniRSttt 

4UI  n  emrin  for  rats  ima  tst  v 

4ta(  *  ratT » N  •  a  H  iri/it: 

4t3ii  *n  UK  Fon  rats  insa  sEcncs:  locitmti  <  uk(M)  « iz  *  uacttzi'i 

4t4«  /iIXiraHEKt  UKtIfI  •■fFS.St41i*ST1l  EHUM  •■•FI.Si4Ii’N  •'iFtl.Si 

41SR  •■fFtJ>4i.*s7g  am  *‘,n.s, 

4liW  /•IXi'SUmilT  $T*TI$T1CS1*|/Itx> 

417N  *t  sanuio  UK  •■iFT.Sttni'sn  Enm  est  •*iFti.4i/iix. 

41IR  ■IBrit3Xi*»*tff.5.«XiraS«*.tlXf*«'fF4.3f/,lX. 

41SM  f  «n(r.7X,*»«,F4.4.8X.*9.  F.  (R/O)  »  ir.Ui/ilXi 

4zm  ra  sauMa  iicTua>*iF7.3i/iiXinrni 

4Z1I  FtllT  7f 

4Z3IC  CALCUUTE  ARB  FRHT  THE  AEBSSSIOR  AESUITS  FOR  T«  FtU  MOa 

4ZSI  OEMR  >  tlSSXt-ItliR*S»RXt)*(SSXZ-iaARtSURU)  •  (SRXlXZ-UMRtSURXZ144Z] 

4ZM  It  >((SSn-IZI«R*SiniZ)MSURXtT-IUA8iSUHT)  • 

4Z7lt  (SRXta-XtmiSURai*(SORXZT-UIAjl«SURT)WtlEMR 

4ZM  R  •  (($S11-IIIM*SUXX1)  »(SaiXZT-iaM»SURT)  • 

4zni  (SRxin*iiiM*suRni*(suRxu*xiuR*sunTn/iEnH 
43N  M  •  IM-ltniRAR-RUZUR 

43M  All  «  If.HM 

<»  FRIRT  14 

4331  14  F0RMT(lXi73(M-| ,/,4X,*HESaTS  OF  CORIIHER  COHUUnVE  FWDUCTIOrt 

43401  ■  AM  FROWCTtOR  MTE  Mnia*iF«tX(ra(*n./,tXi*CASri3li*0BSEllVEriSX> 

433K  ‘nESiCTEr.ni’REsiaia'iSXf*:  OEOiATiort 

43M  80  UZ  t«tilRMES 

4371  Twa  «  M  *  It  •  ltd)  *  n  *  Ud) 

4311  iaia<  Tin  >  roRa 

4371  ssa  •  ssa  *  AESia  H  z 

44M  ssra  •  ssta  *  atii  •  tiar)  h  z 

Mil  rair  •  ti  H  TMa 

4<Zt  «ES»  •  MSd)  •  raAT 

4431  FERCEIT*  (RESIO  /  HRSd))  «  tM 

4441  SSE  *  SSE  *  AESU  »  Z 

MSI  SSTO  >  SSTQ  f  (HRSd)  '  HRSIM)  **  t 

44W  FRIRT  Ml  I  iMRSd)  i  nWTiREStOiFEXEIT 

4470  (tZ  CORTiaOE 

muc  CALOua  am  fiiht  smisncs  for  the  fol  ima 

43»  MFI  *  RUSES  •  3 
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4SU 

4SM 

434« 

4SSI 

4SMC 

4971 

49H 

43»# 

44M 

Mil 

MU 

4471 

4i4f 

4491 

4441 

M7f 

44M 

44flt 

47fH 

47tn 

47U( 

47m 

474l( 

479H 

474M 

47711 


issrx  *  ssai 

txi  I  Din 


/ : 


nsa. 
nisa 
sa 
nn 

4V«L 
VMM 
$£M 

sat 
saz 

K8L  •  (SSTOL  •  SSO,)  /  SSTOi. 

WW  •  (SSTO  •  $M)  /  SSIO 
SMTIO*  THSM.  /TIIStL 
fit  •  IWSL  •  RSIU)  /  (It  .  (iMt.1 
Fiz  •  (Rsa.  -  RSQt.1)  /  Id  .  usa.) 


satrtnm) 

•  IIC4S£S»tSSIl  t  SSIZ  •  SMIIZ  Zl  •  SUHIltlSUIlIt  ♦  SSIZ  • 
SMUZ  ♦  SWIZ)  »  SUHKWSiJIlIt  »  SIIIIZ  •  SSH  *  sumZ) 

»  ISSIl  •  «IZ  •  SW1I2  «•  2)  /  :vM. 

•  nsa  ♦  «v(H. 

•  SOIT  IVMNI 

•  s«ri(Tisa  *  (SSIZ  •  izsm  *  swxzii  /  jrim) 

•  SMTiinsa  *  ISSIl  •  him  ♦  suhd)  /  oaom 


IZ  •  LOCIIZ)*! 


/  (IK4SZS  •  71) 

. . .  /  IICASCS  •  3)) 

19  fO(IMT(lI»79(  i*)t/.lli"TH£  ZOMTIIM  FOR  THIS  HOOa  IS:  "i 
•  tHRI  .  M  ♦  II  ♦«  II  .  u  H. 

■w  IK  FORK  THIS  WOa  KCOIfSt  LKirmi  «  {.KlUl  ♦  81  «  LK(ii| 
/ilIi'HHERei  LK(U)  •-.FI,S,4I,-STI  ERROR  ••,F8.9>41i''}|  .*,811  5, 
/.13I."I1  ••.FI.S.4I,*STB  ERROR  >*iFI.5r4I.'F(  ••,FII.»,/, 

131.12  ••,81.9.41,171  ERROR  .-,FI.3.4I,T*  .-,fll.4,/,ll, 

"SIHIIMT  STATISTICS:*,/.!!,"!  SOtMREO  LK  •*,87,9.111. 

8  RATIO  .♦I,"**,8».4,SI,“0.  8.  (H/|)  .  Z/",I3,/,H, 

•R  SOIMREO  ACTUAf*,Fr.3,/.lI, 791*1*)) 


47M  FRUIT  71 
^  PMT  III  •  PRCTICTIVE  AHLITT  TEST  ORTIOH 

— .».«« — 

IMJ  M  111  t,.!  tVMMMk 


4»l 

4141 

4171 

4MI 

4sm 

4MN 

4Rtn 

4nn 

4m 

44411 

4m 

444M 

447K 

44N 

4tM 

SIN 


M  113  HI.ITRIMC 
ITESr  >  KASES  •  I  •  I 
8RIRT  lA.ITEST.HRSHTEST) 

14  FORlwriU, 114, '■»•),/, II, *i*,37i,"SnORTRAHeE  PRaiCTIVE  AHLITT  *, 
•C0«PMISflll*,37I, ***,/, II, "j'dM, 

l*>13,"  UHICH  HAS  M  OISERVEO*. 

fUliS  Of'  iF9.2iUIi*»*i/i 

(lEMHIRC  CURVE)  *, 

'»'*»«*, 31. "FULL  (CUlWLATIVE  FROOUCTIOH  (  FRODUCTIOH  RATE)  *, 

woa  ,zi,*i*,/,ii,"»*,«  CASES  •,iM("i"),/,u,**  osa  » *, 

•8RE0ICTI0R  •  I  OEVIATIOH  •  EST  81  ♦  EST  II  •*  *, 

•RREOICTIOH  ♦  I  OEVIATIOH  •  EST  M  ♦  EST  II  ♦  EST  IZ  i*. 

/. 11, 1141***)) 

M  U4  J>t.ITRUNC 
ICASEI  .  ITEST  •  J 
SWT  >  I 
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Sftf 

out 

•  f 

SRI 

SUlU 

•  f 

sm 

SSII 

•  f 

SMI 

an 

•  f 

SOI 

sontt 

•  f 

sfa 

Siam 

•  f 

sin 

sum 

•  f 

SIN 

N  111  XMiIOSS 

SIN 

sun 

•  sun  Min 

SIN 

soni 

•  sunt  *  itin 

SUf 

sum 

*  sunt  *  ntn 

sia 

SRI 

•  SRI » inn  H  t 

SIN 

ssn 

•  ssn  *  nin  i« : 

SIO 

sontT 

*  saniT » It  in  » Tin 

SIM 

sonzT 

•  suntT »  ntn  <  tin 

SIM 

Sinn 

•  smn  *  inn  *  nin 

»»  uscainMC 
SIM  itmiTi  •  icaain  *  i 

sm  TIM  « SUIT  /  tcasn 

sm  itM  •  s«(t  I  loses 

szif  lOM  •  sunt  /  tosts 

sm  111  t  (sgniT .  ((suRi « sunri  /  losesii  /  (sni  •  (sunt  m  :  i  tosaii 

saa  m  •  tim  •  iii  *  iim 

ttfi  *  If  H  m 

sta  nun  •  n  h  (mr  « m « uiinsrii 

szu  m  •  MsincsT)  •  nun 

szn  MEndOMTii  •  itsiicni 

S2M  SUUKVI  •  SUUKVR  *  ASEVlilCaaini 
sm  niEvi  <  iH » OEn/wsdnsT) 

sw  mtm  •  MidcvRi 

sn  IF  (tfKw.cT.if.fi  ca  TO  nt 

sa  icaono  •  icomto  *  t 

sta  IF  iincw.cT.3.ii  co  ro  ni 

SMI  tcoona  t  tcoona » t 

sisi  at  KM  •  (issit-aMR*suinti*(ss:{-iaM*sun:)  •  (snm-uMitsaimMt) 

S3W  iiF  •  (i$m*ta«RisimR)*(snKir-uiM«suiin  • 

sm  (snin*iiiM«$aia]«(saiRT-iaM«suiiTn/oEMi 

SM  KF  •  (ISnMllM«$Uni)*(Sa«2T-RIM*$UIITI  • 

ssm  (snm-uiMt$ain)*(SuutT-iiiM»suiTiwoim 

S4M  MF  •  TM  •  IIF  *  tlMR  •  »  •  UMI 
S4lf  MIF  •  If  H  HF 

sa  nuTF  •  If  ♦»  INF « IIF  •  Hinon  ♦  rf  *  aiiTEsni 

SOI  KfF  •  winesn  •  intf 

S44f  URFdOWni  •  «|S(K«n 

S4N  SUMKVF  t  SUMIEVF  *  MOFdCOUmi 

S44I  nCN  •  IN  «  OEVF/lMdTCSn 

S47I  tnof  •  MSIFKVFI 

SOI  IF  imciF.cT.if.i)  o  n  at 

S4N  tCMTCF  •  ICOUMCF  ♦  t 

3SN  IF  (iirK«F.er.3.fi  a  ro  zft 

an  icaunF  •  iowtif  *  i 
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sni  m  ntRT  ir.lCASCSirMTR.nEVX.AtMiltllfnHTF.rtlCVF.Alir.llfiKF 
SMI  17 

SSSK 

ssu  tucoNTtmn 

S97I  MINT  n 

S5M  nrmK\m,mi'*'),iinii) 

SSM  COWT  •  COUNT  *  t.l 

S4H  atci  >  COUNT  /  2.1 

Sill  aicz  •  OMi  •  (NTiaicu 

S4»  IF  (Fun.lft.l.t)  CO  TO  II) 

U3$  FlINT  71 

SMI  U3  CONTINUE 

SiSI  AVCAOCVN  >  SUMOEVN  7  IC0UNT4 

SUI  NVCAOeVF  •  SUNtOCVF  /  ICOUNTN 

Si7l  DO  lit  1  •liICOUNTI 

SMI  MDCVI  •  SSBEVR  »  lADEVNIll  •  NVUSEVRIhZ 

SMI  SSDEVF  ■  SSDEVF  *  lASCVF(I)  •  AVGADCVFIHZ 

STM  tit  CONTtme 

S7UC  CAUUUTE  AM  MINT  RESULTS  SUMIUT  FOR  FREDICTIVE  AIIIITT  TESTS 

S7AI  tARAOEVR  •  SSOEUR  I  UCOURTA  •  ii 

S7SI  VAMOEVF  >  SSDEVF  /  IICOUNTA  •  II 

S7il  TESTSTAT  •  (AVCMEVR-AVCAOCVFWSCRTUVWAIEVR/ICOUITAIMVMASEVF/tCOUNTA)) 

S77I  KENTER  >  111  •  ICOUNTER  /  ICOUNTA 

STM  FCENTCR  >  IN  •  tCOUNTCR  I  ICOUNTA 

S7TI  KENTEF  •  IN  •  ICOUNTEF  /  ICOUNTA 

SIM  PtCRTCF  •  IN  •  ICOUNTCF  /  ICOUNTA 

Sill  PRINT  tS’AVCADEVR.AVCADEVF.VARAOEVRiVAUDCVFtTESTSTATiICOUNTAi 

Sim  ICOUNTAi  ICOUNTERt  ICOUNTEFtPCEHTEA.PCEKTEFt  ICOUNTCRi  ICOUNTCF  tPCENTCRi 

U3lt  PCENTCF 

SMI  tS  F0RNATIUt47l“n./iiIiM*.lll,"SURNART  Of  PREDICTIVE  ADILITT  TESTS". 
SDSM  •  RESULTS". lZl.*«*,/.lI.A7t***)./. 11. "ITERS  OF  INTEREST".!!, 

SMIR  •»  REDUCED  NODEL  *  FULL  NOIB.  **./,U.A7("*"l./.lI,"i  AVERACE  ", 

5171*  "AISXIITE  DEVIATIflr.71,"*",3l,Ft.2,31,"l".Il,Ft.:,)l,"»"./,II, 

SUM  "I  VARIANCE  OF  AISOLUTE  3CVIATI0NS".a."i".ll.Fll.Z,3!.*i".FI1.2,3!. 

Sim  ■•"./.ll."*  TEST  STATISTIC  (SEE  NOTE)", •—".«,"*".a, 

Stm  Ft.2,31."«"./,u."l  TOTAL  NUMER  Of  TEST  SITUATIONS  »*.M,  13, 

Stin  SM), AI. *•*./. Ill"*  NUNDER  OF  PREDICTIONS  VITKIN  SI  «".4I.I3,4!. 

SWM  •l•.SM3.4I,*••,/,lI,•l  PERCENT  Of  PREDICTIONS  VITKIN  51  i*,4I,F4.l, 

5t3IS  Sl.*l*.31,F4.l,SI.***,/,ll,"l  NUNIER  OF  PREDICTIONS  VITMIN  111 

StAM  41, 13.41. "*".51, 13,41. "I",/, II, "•  PERCENT  OF  PREDICTIONS  VITKIN 
StSU  41,F4.D,51,*»",31.F4.l,3I,*»",/,II,47("*"),/,U,"NOTE:  IN  TESTINC  FOR  ", 

Stm  "STATISTICAL  31CNIFICANCE  USE  STUDENT'S  T  0ISTRIWTI0N"./,lI 

StTM  "IF  THE  NUNIER  OF  TEST  SITUATIONS  ARE  USS  TKAN  41.  OTHERKISE  ", 

Stm  "USE  STANDARD", /.ll.’NONNAL  DISTRIIUTIDN.  IN  EITHER  CASE  THIS  IS  ", 

Sttit  "A  ONE  TAILED  TEST.  IF", 7,11, "THE  TEST  STATISTIC  IS  CREATER  THAR 

Ami  THE  CRITICAL  STATISTIC  ORE  NAI",7,H,"COIW.UOE  THAT  THE  AVERACE  ", 
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Mill  *MnuT(  oerunoi  mrina  inn  nc  nu%/fUi*ima  » ■* 
Mm  ‘iioiirtCMiir  less  thm  rair  nnisa  ittM  nc  ouca  im/i 


MMC  mt  It  •  nuena  m  lainitm  miiii  omoi 

MMC 


MM  iM  IF  («Baa(4i.a.*«*)  co  ri  ta 

MM  MVUT  •  PUTIKMCSI 

UN  rtin  n 

Ull  M  117 

UN  MflFUT  •  MMUr  »  .11  *  FlOTnCISQ) 

UN  Ktfurui  •  MTMlWlim 

UU  MNITI  •  .M  *  ttIC(KIS(5> 

UM  n  ui  >ui 

UM  MOMTC  «  MMMC  »  .1  «  MTElKISai 

U7I  TMttrcul  •  umic 

UM  FWSUiJi  •  Ml  •  CMUTiniMt  »  mMICUlMQ 

UM  uicnriNc 
UM  ItTCMTlNI 
Ull  tSTMT  •  I 

ua  »nr  >11 

UM  N  ta 

UM  nUT  IttlFMMMMli'J-lfVt 

UM  •»  m  socnitm  icrnr. 
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Section  3 


This  section  illustrates  the  use  of  PRODRATE  with 
an  artificial  data  base.  The  artificial  data  base  was 
designed  to  meet  two  objectives.  First,  it  was  designed 
to  approximate  an  avionics  production  program.  Second, 
the  data  base  was  designed  intentionally  to  make  the  cumu¬ 
lative  production  and  production  rate  model  clearly 
superior. 


msMTc  iasmaioK 


ms  menu  is  oBiaa  to  essumtc  tk  vMMTin  » tuen  umr  RSwatoBiTs  ts  t 
raerm  os  cinunvc  nooacTiw  m  nooiiCTiM  urc.  is  uniriiMf  nc  iumltst  ar 
coMK  TK  Ksars  onom  rao  tk  stuomo  liMiuic  omc  uitn  tk  ksolts  otaiko 

FGM  TK  OMUTlve  mSOCTlW  AM  miKTia  UTE  ROOa.  TK  COST  AOOOS  USQ  M  IMS 

noOM  AS: 

U  coco  Nia  CSTMOSU  liMiaC  CORK  MKU 
T  •  M  •  (U  w  Itl  «  (II  M  O 

L  nu  MKL  tenaurm  raaocTioi  a«  nosicnoi  ate  noai 

T  «  M  *  m  »  It)  *  (U  M  R)  «  Ilf  H  E) 

KK:  T  IS  TK  IIKCT  UMO  KOOIKICITS 

XI  IS  IK  OMUTIK  raOUCTTW  PLOT  POIKT 

a  IS  IK  macnoi  mte  mxT(E.c.  ewivalejit  nos  per  mm) 

E  CKSOn  TK  Enoi  TESR 

Mf  til  AM  n  AS  PMARETQS  KTEniC  IT  KOESSin 

MTA  AK  IVOT  IT  AEUnC  FROI  AIT  PROPEILr  FORMTTa  MTA  FtU.  TOW  UTA  FTU  SKOOU 
K  SAOO  TO  at  PES2WKRT  FTUMK.  TOO  HOI  IE  AK  TO  TCT  TK  KK  OF  TQOI  BATA  FILE 
AT  IK  AmOPRIATE  STEP  Tl  TK  PtOOUa.  TK  AAK  OF  TOUT  MTA  FOE  CAI  ROT  THTEB  I 
OMACTEIS.  TK  FTKT  LUC  OF  TK  lATA  FTU  RtST  CSKAtll  A  LIK  KISEit  AM  TK  mOSt  OF 
CASES  TO  g  RAO.  IK  MTA  IS  IKES  E3(TEK0  OK  CAR  PES  LUC  tl  TK  FOaOSIK  ORC: 
inc  waOi  otsEtvo  otiEcr  usoi  rootsesit  (tii  cokutive  prqoucttw  plot  poin  titii 

AK  PMCOCTTOI  lATE  PROXT  IXZ).  TK  PSOOUM  USES  A  FKE  FIELS  RAO  FORRAT:  THESEFOKi 
EICa  TKMU  (BIST  K  SEPARATES  IT  AT  LEAST  OK  SPACE  (OR  OTTO  OaiRITER)  NT  AO  OTKS 
SPECIAL  FOniT  IS  AEBOIC.  Al  EIAVU  OF  A  MTA  FTU  UlTM  S  CASES  IS  PRESESTEO  KLOUt 

too  3 

tot  too  14  1.3 

IK  to  N  a.s 

IK  «  S3  a 

no  n  R  17 

105  71  113  31 

OK  MNITAK  OF  THIS  PHOGRAI  IS  TKT  TK  RS8LTS  QITAIC  UILL  K  11  TK  SAK  WITS  AW 
rm  AS  TK  IIWT  MTA.  FOR  EXARPUi  IF  TOO  AK  WRKW6  »  OIRECT  UOOR  HOURS  PER  IWATH 
AK  EgONAUNT  WlTSi  TK  RSSITS  UIU  K  I«  TERRS  OF  TKR  WITS,  ALSOi  IF  TOO  «SH  TO  OSE 
A  CORUTTK  IRSAK  APPROAOi  AU  TOO  REED  OO  IS  ACGSECAIE  IK  MTA  iASE  II  TMT  RAMER. 

tk  PKCRAR  RCTW  it  TRARSFOSaiHC  TK  IWOT  BATA  TO  CQKOH  LOCARITHS.  LOC  LUCAR 
RECKSSia  IS  TKR  PERFORC  AS  POLLOUS:  T  RCKSSEO  OR  III  T  RCRSSES  OR  17i  AAO 
TTRRU.T  I  AECRESSER  OR  BOTH  It  AM  a.  BISERVEO  BIRECT  USCR  REQOIREHQITSi  PREDICTES 
IIKCI  LARK  KaiREdSi  AM  RStOOBLS  AK  PRIITEO  IR  ORICIML  (ORTRAISFORO  FORR  FOR 
EACH  REOKSStOI  StTOAnOi.  tl  AOOniORi  SORRMT  STATISHCS  AK  PRIRTED  FOR  EACH  AOOa.  TK 
NKAM  STATISTICS  IICIIIK  TOO  COCFFICCERTS  OF  BCTERHIMTTOH  A  SSUARE9  LOC  AK  R  SSVARO 
ACTTML.  TK  A  SSOAAEO  LOC  KPRESEATS  TK  COOCRESS  OF  FIT  OF  TK  IWKL  TO  TK  TTUlISFORC 
MTA  tlOCFORR).  TK  I  SCOAKO  ACTSAl*  ON  TK  OTHER  KAMi  IS  CORPVTEO  OSINC  TK 
WIIAOIFOna  KSTNALSi  AM  IS  KPKSEITATIK  OF  NOO  UEU.  TK  HOia  FITS  TK  URTRAISFORlia 
MTA. 


128 


JOtMl  WTIOIB  «t  av«IUU  UITNII  THIS  FMCUa  M8  CM  1C  SdiCtO  II 
USHOS  rt  INC  FlUOHIK  tUCSIlOS: 

t.  N  TOO  HMT  TO  QCCX  MT*  M  IT  IS  KCM  FliOl  Flli . MO  COHVCKIO  10 

LdGMITWST 

ICS  •  Via  CWSC  THE  FtUTIK  OF  «  LISTIK  OF  THE  UTIOHM.  INFUT  MTO  MO  TIC 
ttSOCUTEO  LOCMIIWIC  VALUES. 

■  •  SUPriESSCS  THIS  OPTIOH, 

I.  n  TOO  MKT  A  COMAOISOI  Of  THE  SHOOTUIKC  WaiCTI«  MILITT  OF  THE  TSO  (IOOELS7 

ICS  •  lia  CAUSE  THE  FSEOICTIVC  AltLITT  TEST  OFTtOK  TO  tC  ACTIVATEB  AW  THE  USE*  HtU 
K  ASHES:  'NOH  HUT  CASES  OO  IQU  HISH  TO  THUHCATE?'  THE  AESFOHSE  TO  THIS 
OKSTIOI  MI  IE  AST  IHTECER  VALUE  CSEATEH  THM  00  EQUAL  TO  Z.  THE  PHEDICIIVE 
MILITT  TEST  SIIWUTCS  FUTUOC  FtEOICTIO*  IT  FESfOOHIHC  A  STENISE  TRUSCATIOK  OF 
THE  HISTORICAL  lATA.  FOR  THIS  ACASOHi  M  (mi  LIRITATIGH  OK  THE  XUHia  OF 
CASES  lOUaCATEJ  USULO  IE:  UTOIAL  WMCR  OF  CASES  IR  DATA  FtUI  I  Z)  •  I 
FOR  EIARFlCi  IF  TOUR  DATA  FILE  CORTAIHS  U  CASES*  TOUR  UFfER  LIRIT  VOULD  BE 
Z3  CASES.  THIS.  OF  COURSE.  REFRCSaTS  ORLT  THE  RAIWOR  KUWCR  OF  CASES  THAT 
CSQU  K  TRURCAia.  IR  FRACTICE  TOU  RAT  KART  TO  THUHCATE  «R.I  A  SRAU  HURICH  OF 
CASa.  TIRB.  IF  T«R  SATA  IS  COLUCTEO  IR  RORIHLI  IRTERVALS.  TOO  CM  LOOK  AT 
THE  FSOICTIK  MILITT  OF  THE  FUU  AW  REDUCEB  IMOaS  FOR  AH  II  HOHTH  TIRE  SPAR  IT 
SftCiniRC  LIKEHISE.  If  TOUR  tATA  IS  COLLECTEB  IR  OUSRTEilS.  TOO  CAR  LOCH 
AT  THE  FRCBICTnC  AIILITT  Of  tOTH  ROOaS  FOR  AR  IS  ROHTH  TIRE  SFAR  IT  SFECIFTIRC 
'4'.  IfTO  AU  FSQiatVE  ASILITT  TEST  SITUATIORS  ARE  FRIRIEB.  THE  PROCRA* 

PtIITS  A  SURRAIT  Of  THE  TEST  RESULTS. 

m  •  supFRcsscs  rats  oftior. 

3.  10  TW  VMT  frojectior  ARI  sersitwitt  ratrh? 

lES  •  Ota  CAUSE  PRIRTTRC  of  PROKtaiOR  AW  sessitivitt  ratru.  this  rathii  freserts 
FtOJCCTCB  DIRECT  LAROR  RECUIREREHTS  FOR  SEIECIED  FAIRS  OF  CURUIATI'C  FROCUCTIOH 
HOT  FOIRTS  AU  FROOUCTIOI  RATES.  THE  FROJECTIOR  IHTERVAL  FCR  THE  CURULAIIVE 
FROIOCTIOH  FLAT  FOIRT  IS  U  Of  THE  LAST  OISERVEO  VALUE.  TIC  FROJcCTlOK  VALUES 
FOR  fWKKTIOR  RATE  ARC  Tl.  SI.  W,  IH.  Ult  III.  tSI.  141.  ARO  131  PEKCEHT  Of 
nC  LAST  OSSERVEO  VALUE  Of  FROlUCTIU  RATE. 


n  •  SUFFRCSSES  THIS  OFTIOR. 


UK 

IKCnUMtlMB 

cn  noinjr  ranr  •  moucrtaa  mie 

MKI 

UriOML 

iKainBi 

UTIOM. 

UKMITOI  »  UTIOMI 

uKiiinn 

U1 

im.M 

3.43uaf 

34.44 

1.413479  * 

i.n 

4.3S44ZS1 

IfZ 

m.m 

1.414719 

19.44 

1.143191  • 

1.9 

4.394417 

la 

Mt.a 

z.aiiSN 

313.44 

1.4433443  * 

4.43 

1.443349 

IM 

M.N 

1.74I1M 

(S4.M 

1.4371334  « 

4.14 

4.4137141 

IIS 

m.m 

1.449444 

49.9 

1.744379  « 

3.31 

f.TUTZTZ 

tM 

44Z.N 

tU44t4a 

745.9 

1.4443471  * 

3.9 

4.7471331 

117 

<37.W 

1.44I4I14 

149.9 

3.911441  < 

4.47 

4.1141443 

IM 

4f4.a 

1.4MI14 

194.9 

3.91349  * 

4.71 

l.3147Za 

Mf 

3U.N 

lJ4SMa 

149.9 

3.1744411  t 

7.9 

I.I4S41M 

111 

147  .N 

i.S4ans 

1775.9 

3444149  ♦ 

7.3T 

1.347449 

m 

3a.w 

i.3iaia 

941.9 

3.393417  « 

7.71 

1.913373 

ta 

ia.N 

t.3IS13N 

1411.9 

34134444  « 

1.9 

4.194434 

tu 

117.N 

1.3411343 

1744.9 

3.4413Z9  » 

1.9 

4.134349 

114 

in.M 

1.4433443 

3174.9 

3.31199  * 

1.« 

1.931741 

113 

at.M 

1.41443a 

3337.9 

34314334  • 

14.31 

1.111449 

iti 

M4.N 

1.419734 

3474.9 

3.3444444  * 

ll.lT 

1.143433 

117 

m.a 

1.4741ia 

4431.H 

3.443S5S1  » 

11.9 

1.171339 

111 

tW.H 

1.UZ31W 

4444.9 

3.413911  * 

11.9 

1. 119417 

ttf 

m.M 

t.4S31ia 

3434.9 

3.97439  * 

11.17 

1.19379 

la 

tn.w 

1.4444441 

3434.9 

3.7731734  ♦ 

13.9 

1.1244341 

in 

OtM 

1.431349 

4441.9 

3.3111447  < 

13.43 

1.19139 

m 

za,M 

1.4144337 

4471.9 

3.1433374  « 

U.1I 

1.1433471 

la 

a4.M 

1.44tl4N 

7441.9 

3,3743341  « 

14.13 

1.1347131 

Ul 

TS»M 

1J4744M 

494.9 

3.1fr«l4  » 

14.43 

1.143974 

la 

ta.N 

1.941441 

4434.9 

3.4374141  • 

14.13 

1.179113 

la 

nt.a 

14713474 

4141.9 

1.4444471  * 

13.11 

1.1344473 

to 

ns.N 

1471449 

4341.9 

3.443349  * 

13.43 

1.1143143 

la 

az.H 

144S44M 

14434.9 

4.J141143  « 

14.9 

1.932144 

la 

ai.w 

14374341 

11431.9 

4.149144  * 

14.9 

1.119171 

m 

a4jff 

143I14M 

1149.9 

4.443349  * 

1404 

1.214734 

131 

m.m 

1444349 

iar.9 

4.973144  « 

14.17 

1.294414 

« 

ai.a 

1.394S4S 

199.9 

4.194474  « 

17.17 

i.a72?a 

131 

m.N 

tJSWOJ 

13344.9 

4.194447  ♦ 

1704 

U:U343 

114 

Zt4.N 

1434419 

13144.9 

4.1414134  » 

17.11 

1.994431 

133 

ai.M 

14149:4 

14337.9 

4.134439  * 

13.41 

1.99137 

m 

at.w 

1.391443 

143U.9 

4,1711441  ♦ 

13.3 

1.043414 

137 

ai.w 

1413U7Z 

13434.9 

4.184449  * 

11.41 

1.03439 

la 

a3.M 

144744U 

14443.14 

4.93494  * 

11.9 

1.1414437 

lit 

ai.M 

1441I3N 

14434.9 

4.2Z151S4  < 

11.71 

1.1734134 

la 

11t.N 

144U4SZ 

17171.9 

4.94319  * 

13.14 

1.97339 

n  t  >«.tn37H  *  I.NMM*  *  l.m<3R 


n  *  •i.iMias  •  i.tiMsn  *  i.mmin 


130 


KSliLTS  OF  THE  STWGARI  LEMIIM  COIVE  moa 


CASE 

0ISES1U 

TRESlCnS 

EESIIIUM. 

7  KVlinON 

t 

IM.N 

1034.43 

31.33 

4.74 

3 

0*3.01 

777.41 

73.31 

1.41 

3 

441.11 

417.11 

n.ii 

3.71 

4 

SU.II 

333.41 

4.31 

0.71 

3 

413.10 

507.31 

-14.31 

-7.17 

i 

44Z.H 

474.73 

•17.73 

•7.43 

7 

437.00 

443.03 

H.03 

•1.57 

R 

404.10 

471.34 

-17.34 

-4.33 

t 

340.M 

314.n 

-71.77 

-7,11 

to 

347.N 

tn.n 

•30.11 

•1.11 

n 

330.M 

340.70 

-30.70 

-1.33 

It 

3».M 

3U.I1 

•74.11 

•0.11 

13 

317.00 

333.30 

-14.30 

-3.14 

u 

313.00 

370.43 

-7.43 

•t.M 

IS 

301.H 

310.37 

-1.57 

•0.41 

14 

304.H 

3H.10 

3.10 

I.OZ 

17 

m.oo 

711.44 

4.U 

7.70 

II 

m.oo 

707.41 

7.31 

7.33 

11 

Zt4.0l 

773.13 

0.07 

3.17 

tl 

nt.oo 

7U.31 

1.41 

3.U 

tt 

no.oo 

747.37 

7.40 

7.04 

zz 

743.00 

734.74 

4.74 

7.30 

Z3 

tS4.0* 

731.30 

4.47 

1.73 

» 

ZSO.H 

7U.74 

3.74 

1.30 

ts 

t4S.0l 

741.34 

3.44 

1.40 

u 

Q1.M 

737.14 

l.U 

0.07 

V 

733.00 

73Z.U 

7.14 

0.11 

a 

737.00 

770,11 

3.01 

1.30 

a 

7».0* 

773.37 

7.40 

1.01 

a 

774.00 

777.70 

1.30 

0.00 

31 

771.00 

711.03 

1.13 

4.00 

3t 

7lt.H 

714.03 

1.13 

0.01 

33 

714.00 

713.40 

7.37 

i.n 

34 

714.00 

711,47 

7.33 

1.10 

33 

7II.H 

701.41 

1.51 

0.73 

34 

7*1.01 

707.70 

1.77 

0.07 

37 

704.00 

703.07 

0.10 

0.40 

31 

7*3.00 

707.03 

0.13 

0.00 

31 

ZN.N 

7H.73 

•0.73 

-0.37 

41 

111.04 

tn.ot 

•1.00 

-0.31 

nc  ciMnoi  FOR  this  moa  ($>  tmt  •  to  •  u  «*  ii 

M  UC  FORI  THIS  moa  lECOKS:  ICCITNOT)  t  L0C(N>  *  It  •  LOC(It> 
«BCi  lOCtHI  >  3.4tsn  sn  EKROO  •  I.I34S5  M  <  )13t.SI3l 
II  >-o.a3u  $n  Elmo  •  1.31433 
mm  sTATtsnn: 

I  sanMO  Loc  •o.nits  in  ERm  est  •  o.iim 
use  •  I.ONH  09  •  t.uin 

F  UTIO  >4»S.SltS  I.  F.  wni  >1/30 

R  SOWREO  IICTUH.*«.?SOtt  UMNIK  FOaOR  •  0Z«20t(4  PERCENT 


13L 


•  •*••“••  •▼»•••♦♦»»»▼♦»▼♦▼»♦•  ••“•▼♦▼♦•♦♦I 

Ksain  cf  KossKa  u  ntotuaiw  utc  tmimu  «.a« 


OS 

nsona 

rttBicTcg 

KSIDIM. 

1  lEVUriM 

1 

im.H 

774.31 

113.9 

U.4I 

t 

K3.M 

43t.n 

144.77 

il.N 

1 

441. N 

3N.a 

34.17 

7.n 

4 

S4I.N 

344.44 

13J4 

3.9 

3 

413.H 

314.41 

•a.4t 

-4.77 

i 

4tt.N 

4R.I3 

•9J3 

-4.34 

7 

437.H 

447.B 

•1I.ZS 

•Z.S 

t 

4M.M 

433.31 

•3tJS 

-7.73 

t 

3M.W 

4Z1.I1 

•33U1 

-MJZ 

U 

i47.n 

NS.n 

-31.75 

-14.77 

11 

SM.n 

m.si 

-57.» 

•11.13 

IZ 

3a.H 

371.41 

-N.41 

•13.R 

u 

317.N 

347.31 

•9.31 

-7.34 

14 

313.11 

3Z4.R 

-U.R 

-4.45 

IS 

3K.N 

311.74 

-r.74 

-4.17 

U 

3M.H 

w.n 

4.(3 

1.77 

17 

m.H 

94.44 

11.74 

4.11 

11 

Rf.N 

vi.a 

13.«3 

4.77 

IT 

a4.N 

Ui.lS 

13.13 

3.31 

U 

m.N 

Z4f.31 

17.47 

4.9 

n 

m.M 

B4.47 

UJ3 

4.74 

n 

a3.H 

az.i3 

If.N 

4.13 

o 

S4.N 

ZN.a 

7M 

3.13 

Z4 

tSI.N 

Z43.SZ 

4.44 

Z.S7 

B 

tAS.M 

tn.sz 

3.44 

1.Z4 

B 

m.M 

Z33.ff 

3.!( 

IJI 

a 

S3.H 

ni.B 

3.13 

1.34 

a 

m.N 

ZZ7.44 

4.34 

tJI 

» 

SI.H 

B4.4Z 

3.31 

1.37 

w 

S4.N 

mji 

tM 

1.9 

n 

m.N 

at.a 

U\ 

1.ZZ 

n 

a«.N 

n5.47 

IM 

1.14 

a 

Z14.M 

m;.it 

3.17 

1.47 

34 

U4.N 

Z1I.3T 

3.41 

1J7 

33 

m.N 

ai.N 

Z.1S 

l.R 

34 

at.N 

zr.n 

1.75 

1.73 

37 

a4.» 

93.44 

4.34 

1.9 

31 

a3.N 

ZM.14 

•1.44 

•I.3Z 

3T 

ai.N 

-Z.44 

•1.9 

4« 

IN.N 

91.17 

-3.17 

•1.43 

IK  caMTin  m  mn  ma  »:  mr  •  m  *  a  h  r 
n  IK  Fun  THIS  NKL  KCOCS:  lK(Tmn  >  LKtni  *  R  •  LOCdZI 
VOEt  UKtN)  >  1.23374  STV  OiROIt  >  I.QU3  H  ■  17Y3.i77T4 
R  •-4.743IS  ng  Qom  i  t.n\n 
mm  sTAnsTia: 


ISOttOLK 

•(.74I31 

sn  am  est  • 

4.43(7 

NR 

•  f.(N74 

RSN  • 

1.1179 

Fttvn 

■lltt.K43 

1.  F.  ONI  • 

1/  9 

t  sama  4CTini«4.73477 

« 

132 


KSULTS  OF  OUllIin  CUMUtTIVE  POOOiXTIin  ANO  PKOOUCriOa  KATE  Nsa 


CASE 

OtSERVEB 

nEOICTEI 

RESICUAL 

1  OEVlATin 

t 

IKt.fl 

lltt.tl 

•1.11 

•l.ll 

Z 

M3.II 

M3.I4 

•1.14 

•l.ll 

3 

441.M 

44I.4T 

I.3I 

1.13 

4 

341.11 

341.17 

•1.17 

•l.lt 

3 

413.M 

4TZ.47 

1.33 

1.17 

i 

44Z.H 

Ul.R 

I.M 

I.IZ 

7 

437.N 

437.lt 

•l.lt 

•I.IZ 

S 

414.11 

414. tZ 

-I.IZ 

•1.13 

t 

348.W 

34I.Z3 

•I.Z5 

•1.17 

tl 

347.11 

347.15 

H.13 

•l.ll 

It 

33f.N 

3Zt.4l 

1.41 

I.IZ 

u 

3Zf.ll 

31t.il 

1.41 

1.13 

t3 

317.11 

317. 4t 

•1.47 

•1.14 

14 

313.M 

313.Z7 

•I.Z7 

•l.lt 

13 

3«B.fl 

3N.T3 

1.13 

I.R 

U 

3<4.H 

3l4.Zt 

•I.Zt 

•l.ll 

17 

ZT6.il 

Zt7.34 

1.14 

1.13 

It 

zn.if 

Ztl.4Z 

•I.4Z 

•1.14 

W 

Z34.M 

Z83.7Z 

I.Zt 

l.ll 

Zf 

ZT8.II 

ZTt.lT 

•1.17 

•l.fi 

Z1 

ni.M 

Z4t.33 

1.47 

1.17 

zt 

Z43.n 

Z4Z.77 

I.Z3 

l.lt 

Z3 

ZS4.il 

Z34.Z4 

•I.Zi 

-l.ll 

Z4 

Z3I.H 

ZSI.Zi 

•I.Z4 

•l.ll 

Z3 

Z43.fl 

Z44.tt 

l.lt 

1.18 

Zi 

Z3T.H 

Z3t.31 

•IJt 

•1.13 

tl 

Z33.N 

Z33.I3 

'1.13 

-I.IZ 

Z8 

Z3Z.II 

Z3t.it 

l.3t 

1.17 

ZB 

ZZS.II 

zn.ss 

I.IZ 

1.13 

31 

ZZ4.II 

ZZ4.37 

•1.37 

-l.li 

3t 

ZZt.ll 

Rl.ll 

•l.ll 

•1.13 

S 

ZIO.II 

Z17.T4 

l.ii 

1.13 

33 

Zli.ll 

Z13.R 

1.18 

1.14 

34 

Z14.ll 

Z13.74 

I.Z4 

l.ll 

33 

Zll.il 

ZU.3i 

-1.34 

•1.17 

34 

ZIT.SI 

ZfS.35 

1.13 

1.17 

37 

ZM.II 

zts.n 

l.!5 

I.R 

3B 

ZI3.II 

ZIZ.t3 

I.I7 

l.lt 

3? 

ZM.N 

Zll.lS 

'1.18 

-l.lt 

4« 

ITS.II 

tT7.T3 

1.13 

1.13 

444***444»44444444444t44fH444444444«444Hi4mHHH444H444444M444MHH 


THE  ESUATIOH  '^CH  TilIS  AQDa  IS: 


THAT 


I>  UK  FOSR  THIS  ItOCa  BECCHES:  UKCHATI 


HHEK:  LOCISfl  >  s.rsssT 
II  «-l.5?«5 
R  >  l.24ilZ 
SUHRMT  STATISTICS: 

I  SAQAAED  UK 
KSE  >  I.HNI 

F  BATtO  tRR.lSiZ 

R  S8UARED  ACTUAL>1.IMH 


N  4  It  44  It  4  IZ  44|Z 

LOCtllt  4  It  4  UK(II)  *  R  4  ICCIIZ) 


sni  ESRIIR  <  f.MUZ 

STB  EKKOft  >  f.nt:? 

STD  ERROR  >  <.H344 

STB  ERROR  EST 
RSR 

I.  F.  IR/BI 


n  >  SU?.3AOf4 
F4  M4it.l349 
f4  =4Z5447:i 

<  f.lMA 
»  1,57713 
»  V  37 


4H«44H4444m4M4m4H4444H444444444*4444»44444444M  44444>4m4444«444« 


smnMci  KtBicnvc  uain  carMisMi  * 

m  UT«  msona  lan  n  ni  use  i  <i  wtex  m  « oniiNo  mm  vi  in.ii  i 


aouco  (ic«>:x  com)  moa 


H  Fvu  (CiMunvc  ^RoncTtM  t  msocriM  nro  moo.  • 


no  • 

nniCTin  • 

I  Kviiria 

•  (IT  N  «  nt  II 

**  micTioa  • 

1  KVMtlCI  • 

or  u 

«  (ST  It 

♦  (ST  It  ♦ 

»  » 

m.M  • 

•I.SJ 

•  sm.ii  t-i.aat 

H 

117.73 

4 

l.u 

1 

3471.23 

•-I.3m7 

♦  I.UM7  ♦ 

«  * 

m.ti  • 

•l.u 

•  sin.a  t-i.mii 

•• 

117.14 

4 

I.R 

1 

34U.U 

•-i.snii 

♦  I.M3K  ♦ 

ST  « 

in.ii  » 

•i.a 

*  s]n.sx  •-i.mii 

•• 

117.13 

4 

1.0 

4 

3m.47 

♦-I.31113 

♦  I.UU1  ♦ 

SI  • 

m.n  • 

•f.SS 

•  st».4i  i-i.atsi 

H 

117.14 

4 

1.11 

4 

SUl.tl 

•-I.S111S 

*  I.U34S  ♦ 

S3  » 

tti.ti  • 

-1.47 

•  SIS.U  •-i.ans 

14 

117.11 

4 

l.u 

4 

3U1.11 

M.snii 

♦  I.USSZ  ♦ 

SI  • 

tn.u  • 

•1.4: 

1  SIS7.SZ  «-i.am 

•4 

117.15 

4 

i.n 

4 

34U.13 

♦-♦.31117 

♦  1.11311  ♦ 

ss  • 

ti«.M  * 

■*.a 

»  stu.4i  »-i.ani 

14 

117.11 

4 

l.u 

4 

3U1.U 

♦•i.smi 

♦  I.USU  ♦ 

St  * 

m.M  * 

•i.tx 

»  1131.43  M.aiST 

H 

117.11 

4 

l.u 

4 

SU1.M 

♦-♦.Still 

♦  I.USS3  ♦ 

St  » 

iit.n  * 

•1.13 

•  iin.a  ^-i.aav 

14 

117.1t 

4 

1.14 

4 

3U1.U 

M.snw 

♦  I.USU  ♦ 

SI  1 

la.H  * 

•l.lt 

•  lllS.n  •-4.il4tl 

H 

117.11 

4 

l.u 

4 

3U1.U 

♦•1.31111 

*  I.USSZ  ♦ 

ff  * 

ttr.ii  « 

i.n 

«  n7s.u  «-i.aut 

M 

117.14 

4 

I.M 

4 

34U.33 

♦-I.SIIIt 

♦  1.14371  ♦ 

tl  • 

ti7.a  t 

l.ts 

»  11M.44  M.asii 

H 

117.13 

4 

I.n 

4 

S4M.<I 

♦-I.311I1 

1  I.U334  ♦ 

n  • 

m.n  • 

l.u 

1  itn.ii  i-i.asTt 

•4 

117.11 

4 

I.IS 

4 

3UI.3I 

♦-♦.3im 

♦  i.iun  ♦ 

a  * 

in.R  * 

l.u 

•  stii.u  M.aia 

•1 

117.11 

4 

I.n 

4 

34U.4I 

♦^.SWI 

♦  I.USIt  ♦ 

a  « 

IU.M  « 

l.u 

*  iai.a  «-i.a7n 

M 

IIT.M 

4 

I.n 

4 

34U.II 

♦-♦.31111 

♦  I.U33I  ♦ 

tl  « 

tis.w  * 

l.tT 

«  ttu.n  •-i.am 

44 

117.11 

4 

I.U 

4 

3U7.n 

♦•i.snn 

♦  l.tuis  ♦ 

n  < 

w.n  V  I.SS 

•  iai.43  •-i.atti 

H 

117.11 

4 

i.n 

4 

3U7.71 

♦•1.31111 

♦  i.usa  ♦ 

a  • 

m.n  » 

t.n 

1  ttn.a  •-i.tnsi 

44 

117.17 

4 

l.u 

4 

344l.a 

♦•i.siia 

♦  I.USIT  ♦ 

♦♦MHt♦♦»♦♦♦♦♦♦«♦M♦♦IM♦t♦♦H♦♦♦il♦♦♦♦IM♦♦^♦^l♦♦♦♦«m♦♦♦«♦♦♦*«»«W♦t»»M^»♦m♦♦♦»♦♦WM♦♦H♦Mt♦H♦M♦♦iH♦«♦«♦ 

♦  sHMiMiKt  nniaivs  uiim  coffuisax  ♦ 

♦  TK  MT4  msUTII  KLOa  IS  FOR  CUi  1  H  WICM  KM  U  OKERVO  IRLIK  Vi  SI.H  ♦ 

t***»»»»*H*W»»*t»**»U**t»***t»»4»*»**t»»»»t»*tMH»»UtUtUM***U»»t****H********H*******t>m******H*t»** 

♦  1  ♦  lOKO  (LEMBIK  a«K)  1080.  ♦«  FlIU  lOMUTIVt  FMaOCTIN  4  PMUatCX  MTfl  KOHL  ♦ 

1  OKI  ♦  mmcTin  ♦  i  rvuttor  ♦  nr  w  ♦  (n  it  ♦♦  nxmaiu  ♦  i  kviitior  ♦  est  n  ♦  est  it  ♦  rt  it  ♦ 

a  ♦ 

tfi.n  ♦ 

•l.lt 

4 

imui  ♦•i.ntu  ♦• 

m.n  ♦ 

-l.u 

♦  3441.11 

♦-♦.SHU 

♦  i.usa  ♦ 

it  ♦ 

tn.n  t 

•l.lt 

• 

itr.it  ♦•i.tstu  M 

ai.i7  ♦ 

-l.u 

1  34U.47 

♦-1.31113 

♦  1.11341  ♦ 

a  ( 

m.n  ♦ 

•♦.« 

4 

im.M  ♦•i.tini  ♦♦ 

211.14  ♦ 

•I.n 

♦  sul.n 

♦-I.SUI3 

♦  I.S134S  ♦ 

13  ♦ 

m.47  * 

•i.a 

4 

iia.u  ♦•i.atn  ♦♦ 

m.is  ♦ 

-I.n 

1  34Wnt 

♦-I.SIUI 

♦  l.llSSt  ♦ 

U  1 

m.34  ♦ 

•i.a 

4 

i(r.3t  ♦•i.nzn  ♦* 

m.n  ♦ 

•I.U 

♦  S4U.1S 

♦-I.SU17 

♦  i.uai  ♦ 

SS  1 

m.s7  1 

-1.11 

* 

ItU.M  ♦-i.ttsti  ♦♦ 

m.t4  I 

•I.n 

♦  3U1.U 

♦-♦.3U11 

♦  I.USU  ♦ 

St  • 

tn.n  * 

-I.n 

4 

itsi.is  t-i.tnsT  ♦• 

m.is  ♦ 

•I.n 

1  3U1.1I 

♦-i.snti 

♦  1.11333  ♦ 

SI  1 

m.n  » 

I.II 

4 

tia.a  ♦•i.tsai  ♦« 

m.ts  1 

-1.17 

♦  3U1.1I 

♦-♦.sun 

♦  1.11313  ♦ 

a  • 

m.n  ♦ 

1.11 

4 

1143.71  ♦-l.tlltl  ♦« 

m.is  ♦ 

•I.n 

♦  sui.n 

♦-I.3111I 

♦  Mist  ♦ 

n  » 

m.a  ♦ 

i.a 

4 

1I73.U  ♦-I.2U4Z  ♦• 

m.n  ♦ 

•l.u 

♦  S4u.n 

♦-i.snit 

♦  I.U37I  ♦ 

a  ♦ 

m.n  ♦ 

I.a 

4 

itu.u  ♦•i.nsts  ♦♦ 

m.i7  ♦ 

•1.11 

♦  34U.1I 

♦-i.sini 

♦  I.USSl  ♦ 

V  ♦ 

in.a  ♦ 

1.31 

4 

itn.ti  ♦-i.tisn  ♦« 

m.is  ♦ 

•1.17 

♦  34U.a 

♦-i.inn 

♦  I.IUI3  ♦ 

a  * 

tn.n  1 

I.n 

4 

nii.u  ♦•i.2S4a  ♦♦ 

m.n  ♦ 

•1.17 

♦  S4u.n 

♦•I.snn 

♦  i.uat  ♦ 

a  « 

in.u  1 

I.n 

4 

XZl.:!  ♦-I.237K  ♦♦ 

m.t4  ♦ 

•I.n 

♦  34U.lt 

♦-i.wni 

♦  I.USSl  ♦ 

tl  * 

117.11  * 

1.21 

4 

ail.  11  ♦•i.tiTn  ♦* 

m.n  ♦ 

•1.17 

♦  3U7.ra 

♦-i.sim 

♦  l.tuu  ♦ 

n  ♦ 

114.U  ♦ 

1.47 

4 

ItU.lS  ♦•1.21111  H 

m.i4  ♦ 

•I.n  *. 

♦  suT.n 

♦-I.smi 

♦  1.11321  ♦ 

a  ♦ 

113.71  ♦ 

Ml 

4 

Itn.ti  ♦•i.ina  ♦« 

m.n  ♦ 

•I.n 

♦  34U.7I 

♦•I.snti 

♦  1.11317  ♦ 

tl  ♦ 

t1l.«  ♦ 

I.n 

4 

SSS1.74  ♦•♦.tins  ♦* 

m.i7  ♦ 

•I.n 

♦  3U7.n 

♦•I.sim 

♦  I.UU7  ♦ 

tWH9***»M»**t*******»HtUH»»»»t»H***t***»»**t*U»»»»*H»***»**H***Ht***»*i 

134 


*  SMRTKAiia  rno(crtv(  u iiiti  covmison  « 

*  IK  MM  PKkurn  KLM  ts  roit  ct'ii  *  » uMicN  MS  M  oisavn  v«.ut  tir<  tis.ii  • 

*  f  •  KMCso  (lURNiiK  cww)  moci.  •*  mi  (ctHmTtvt  maiKTiw  i  mcucum  mtci  mxi  • 
»  cuts 

I  isei  <  FSniCTtM  I  l  KVIAItW  •($!(«•  (Sr  It  ••  PKtICTION  •  I  KVIAtlM  «  Ht  M  «  UI  It  •  CSt  K  « 


V 

• 

tlM4 

• 

i.n 

4 

)U7.U  l•l.24:«4  •* 

212.12 

1 

I.n 

• 

yUt.i1  4-1.111(1  4  1.14141  4 

H 

1 

ttM4 

« 

I.M 

4 

iin.u  t-i.nai  «* 

212.11 

1 

I.n 

• 

lUt.ll  4-I.SIItl  4  I.M4S  4 

n 

1 

m.n 

» 

i.ti 

4 

iin.44  fi.m?!  •* 

m.u 

• 

I.U 

• 

SU1.1I  4-4.111(1  4  1.14112  4 

14 

• 

nt.ii 

4 

I.U 

4 

)tl7.S2  *-l.2Sn2  «* 

m.n 

• 

I.n 

• 

14a.t5  4*1.11117  4  1.14111  4 

» 

• 

4 

1.4*5 

4 

)iu.4i  M.Tnn  H 

m.n 

• 

I.n 

• 

lUl.U  4*4.11114  4  4.I41U  4 

K 

1 

m.n 

4 

I.n 

4 

nsi.43  *-i.2tn7  •* 

m.u 

« 

I.U 

1 

1U1.U  4*4.11114  4  4.S4151  4 

• 

m.n 

4 

1.44 

4 

)t».2i  •-i.2int  H 

m.u 

• 

I.U 

« 

SUl.n  4-4.S11U  4  1.141(1  4 

» 

» 

m.n 

4 

I.n 

4 

lllS.Tt  4*1.21(24  4* 

m.u 

» 

I.U 

1 

1U1.44  4-|,11ltl  4  1.14112  4 

tt 

• 

m.u 

4 

I.U 

1 

)I7I.U  4*l.mu  4* 

m.n 

• 

I.U 

• 

lui.n  4*4.init  4 1.14171 4 

n 

m.n 

4 

i.tt 

4 

ItC(.(4  41.21511  4* 

m.n 

« 

I.n 

• 

14U.44  4-|.11in  4  4.14114  4 

V 

• 

214.44 

4 

I.n 

4 

Itn.tl  4*1.21171  44 

m.Ti 

« 

i.ti 

• 

14U.3I  4-4.11115  4  4.14141  4 

ti 

» 

HI.S7 

4 

1.21 

4 

icti.u  4*i.mn  44 

m.7i 

• 

I.tt 

1 

liU.41  4-4.1in4  4  4.141)2  4 

a 

1 

2N.U 

4 

t.ti 

4 

im.n  4-1.24712  44 

m.n 

1 

I.n 

• 

liU.II  4-4.11111  4  I.Kllt  4 

M 

• 

tn.n 

4 

1.71 

4 

1244.(1  4*1.21711  41 

m.71 

« 

I.U 

• 

iu;.7l  4-4.1tn4  4  4.14411  4 

n 

• 

141.71 

4 

2.N 

4 

12U.4S  4*|.2ni4  4* 

m.n 

• 

1.11 

1 

1U7.71  4-4, lim  4  4.14121  4 

n 

• 

t47.IJ 

• 

2.n 

4 

ins.n  4-1.21451 4* 

m.n 

• 

I.U 

1 

14U.74  4-4,11124  4  1.14117  4 

n 

• 

I4i.St 

4 

I.n 

4 

ini.7l  4-1.21211  4* 

2n.n 

I.n 

« 

lU7.i:  4*1.11142  4  4.14117  4 

» 

144.71 

4 

4.0 

4 

im.n  4*f.niti  44 

m.74 

• 

I.ti 

• 

1U4.11  4-4.11144  4  4.14)11  4 

44M44444444444444444444M444444444M444M44444444M4444H444444444444444444444444444M4444444M444  444444444 14444444 


4444444444444444444444444444444444444444H44444444444444444444444444444444H44444444444444444444444H444H4444444444 


*  smiTiiMct  Kntntvt  Mtiin  ctsviittsoit  4 

*  Tit  MTI  ntSDTtI  KIW  IS  roit  CASI  I  ]7  WICN  NAS  AN  IIStltVlD  VAlUt  IFi  ni.ll  4 

4444444M444444444<444H444444444444444 444444444444444444444444  44M4444444444444444444444444  444444444444444444444444 

4  $  4  KMCSI  (UAKttNC  CIKtICI  MKl  44  FtJU  (CtIMlATtVC  PWmCTION  (  KMUCrtON  MIC)  NOia  4 


4  CAStt  44444444444H44444444444444444444444444I444444444H444444H444444444444444444444444444444444444H4I444444444 

4  osu  4  ntnicTiw  4 1  kviation  4  tst  m  4  csr  it  44  nttitcTiON  4 1  ocvtATiw  4  csr  11  4  csr  it  4  cst  t:  4 

44444444444444444444444444H444444M44444444444444444444444444444444444444444444444H4444444444444H4444444444444444 


M 

t 

2n.u 

• 

1.45 

• 

)tn.4i  4-4.2in4  44 

m.u 

• 

I.U 

4 

mi.i)  •*i.iii()  1  i.uin  1 

n 

• 

m.H 

« 

l.lt 

• 

nn.44  4.|.m7i  44 

m.n 

« 

I.U 

4 

1U1.1I  i-l.inil  •  1.24512  1 

M 

1 

m.n 

« 

I.U 

1 

11)7.12  4-1.21212  4* 

m.n 

1 

1.17 

4 

1AW.13  •-I.11117  •  I.U12I  1 

n 

« 

2N.U 

• 

1.45 

• 

)t44.4l  4*4.21)24  4* 

m.u 

• 

I.U 

4 

luf.u  t-i.inu  1  i.ulu  » 

n 

« 

m.(7 

• 

1.74 

1 

1151.41  4-4.21117  44 

2n.n 

« 

I.n 

4 

1U1.41 1-1.11111 1  i.uni  1 

It 

• 

m.2i 

• 

1,14 

• 

)IU.24  4*4.:SU1  44 

215.1) 

4 

I.U 

4 

lUMt  t-l.inU  *  M4141  1 

M 

• 

m.u 

• 

I.H 

1145.71  4*4..'1424  44 

m.u 

4 

I.U 

4 

sut.(4  i-i.snii  *  Mini  1 

n 

• 

2I).M 

« 

I.n 

• 

lin.U  4*4.21442  44 

m.n 

» 

1.17 

4 

UU.n  1-I.S11I2  1  I.U17I  1 

21 

• 

m.i) 

• 

(.24 

1 

1I14.U  4*4.mtl  4* 

m.n 

4 

1.17 

4 

nu.u  i-i.nm  *  i.um  * 

27 

• 

2U.I2 

• 

t.44 

• 

1111.14  4-4.:n7i  4* 

m.n 

4 

1.11 

4 

nu.u  t-i.imi  1  M4131 1 

21 

1 

212.75 

1 

I.U 

• 

nt4.U  4-I.214U  44 

m.n 

4 

Ml 

4 

1UI.4I  I-I.IHK  1  M41I2  1 

25 

• 

m.n 

• 

t.TI 

« 

1224.24  4-1.21712  4* 

m.u 

4 

I.U 

4 

nu.ii  1*1.11111 1  i.usii  1 

24 

• 

m.7i 

• 

2.n 

• 

1244.44  4*4.21711  4* 

m.n 

4 

I.n 

4 

1U7.71  I-I.imi  1  M441]  1 

» 

• 

m.H 

• 

2.45 

• 

)2U.4)  4*4.2ni4  44 

m.u 

4 

I.n 

4 

1U7.7)  i-i.nm  1 1.14121 1 

2S 

m.n 

• 

2.11 

1 

1214.21  4-4.2ini  44 

m.n 

4 

I.n 

• 

SUI.7I  1-1.11121  1  1.14117  1 

21 

« 

IH.41 

• 

I.n 

• 

1111.74  4-1.21214  4* 

215.25 

1 

Ml. 

4 

U47.i:  1-I.S11I2  1  1.14117  * 

21 

1 

IH.U 

* 

4.11 

« 

llD.n  4-4.21111  44 

m.74 

4 

1.12 

4 

1U4.21  1-l.lUU  1  i.uin  • 

11 

• 

t14.U 

1 

I.U 

• 

)4U.U  4-|.2in)  4* 

215.77 

4 

l.lt 

1 

uu.u  i-i.sun  1  i.uiu  1 

44444M4444444444444N444444444444444444444  4444444444444444444  444444444 44*44444444444444444444444444444  4444444444444 


135 


sniMRct  mtcTiic  aam  canMuna  * 

m  MM  rasDTu  lain  is  ni  cut  i  u  uitai  ns  m  ossqno  muc  on  af.m  • 

«  •  BHca  (liAMw  COM)  Moa  H  fau  (OEsuTiii  nMonioR  ( msncTiQii  mto  ima  * 


rmiaia 


l  OCVMTlOa  »  tST  II  •  SST  It  **  UQICTia  »  l  SRIITlOa  *  »T  n  I  Esr  It  •  EST  n 


»U.44  «-l.:i93  M 
)U7.s  M.nm  •• 
itu.w  *-4.as<  H 
nst.ts  M.ns37  *« 

JISI.a  H.X33IT  u 

sus.n  fs.aiu  *« 
3t73.U  U 

IIS«.M  M.2I313  M 
3m.  II  M.zisn  H 
3»I.M  »-|.m3l  I* 
3z».u  i-i.arR »» 
uu.M  Hl.tsm  H 
33M.(3  «*l.mi4  •« 
3m.»  i-i.msi  H 
3331.74  <-l.m34  it 
33n.if  t-i.mt3 » 
3444.M  M.ms:  It 
3S4f.33  tH.3R4l  it 


suf.3i  t-i.snti  I  I.I4SS:  * 
S44l.n  t-4.3tlir  I  4.}43lt  t 
SU1.U  M.S1114  I  I.I4SU  t 
suf.4i  t-i.sntf  I  f.S4su  t 
SUf.4t  M.StfU  I  1.14343  • 
3Ut.44  M.3tlll  t  f.ltSSZ  • 
34U.33  t-|.3nt:  I  1.14371  t 
34M.W  t-4.3t4lf  I  1.34334  t 
34a.3i  t-i.3nn  t  i.usn  t 
34U.4I  tH.3tlf4  t  I.44SIC  i 

3441.11  t*f.3tTft  t  1.14331  i 
3U7.7I  M.3mi  1 1.14413  t 
Stt7.73  M.Stm  I  I.MSn  t 

3441.11  M.3TRf  t  f.|43T7  t 
3U7.R  M.3mi  I  1.14337  t 
344443  t-|.Sm4l  i  I.I433I  i 
SU4.44  i-4.3n4f  •  I.I43U  i 

3441.11  t-|.3l77t  I  I.S41Z7  t 


SMniMCt  nZDICTtVC  AlILtn  CSUMtSOI  t 

m  uri  msoTO  klm  is  rot  case  i  33  wtoi  mu  « oissmi  vuoc  on  m.N  1 

ttttltMttmtttttttHtttttHtt»ttttMtt««tttHttttttttHmitHHtt>ttttttltlttttt4tttttttWttttt«ttttttt 

yo  (^ac  como  ma  **  fat  (cuwurni  uowcriw  t  nmoaioi  nro  ma.  t 
noicnoi  1 1  iRiniQi  t  et  u  t  ect  n  u  naicnoi  1 1  KitArm  t  est  11  t  est  n  1  eh  r  t 


34  t 

af.z4  I 

i.n 

• 

n37.3Z  M.aZR  It 

211.34  t 

•4.17 

« 

S4U.73  1-4.37717  i  f.MSIl  t 

31  t 

ar.M  t 

I.R 

• 

3144.41  M.ZSR4  it 

Z1I.34  1 

•4.14 

t 

SU7.U  t-4.S77U  I  I.I4S44  t 

R  t 

m.i4  t 

t.lt 

« 

3131.43  1-1.0337  it 

ni.33  t 

-4.14 

* 

3U7.W  1-4.37714  i  4.11333  t 

31  t 

ai.47  t 

1.11 

1 

aa.a  m.osr  h 

211.33  t 

•4.13 

• 

3447.41  t-4.3770  t  4.14343  • 

U  t 

ai.44  t 

i.a 

• 

3l43.n  1-1.0424  M 

at.33  t 

•4.14 

• 

3U7.M  t-4.377tl  1  4.14352  t 

»  t 

ai.z4  t 

t.lt 

1 

3173.44  tH.ZI4U  h 

21144  t 

-4.17 

• 

340.33  1-4.37712  t  4.14374  t 

a  t 

a7.t3  1 

I.U 

1 

ttM.44  t.|.2ISI3  It 

21143  t 

•4.17 

« 

340.44  t-4.377f7  i  4.14334  t 

U  t 

m.R  t 

t.43 

1 

3171. fl  t-«.2S37l  H 

ai.a  t 

-4.13 

t 

340.0  t-4.37173  t  4.14313  t 

a  t 

ai.is  t 

l.R 

1 

SM.44  »-«.Z44»  H 

211.31  t 

•4.13 

• 

344I.4I  *-4.37174  t  f.|43R  i 

a  t 

34.74  t 

Z.R 

• 

334.0  I-I.07I:  It 

ai.34  t 

-4.14 

• 

344t.fl  tH.STTIt  1  4.I4S3I  • 

Z4  t 

a4.u  t 

Z.3I 

« 

3244.41  M.OTtt  it 

UI42  t 

•4.13 

« 

3U7.n  M.3797f  t  f.S4473  t 

n  t 

as.37  t 

Z.47 

» 

32tt.43  1-4.0714  it 

211.34  t 

•4.14 

• 

3447.73  H.37l7t  i  4.1430  t 

a  t 

34.42  t 

1.1Z 

1 

327147  M.Oia  It 

2u.a  t 

•4.11 

• 

340.74  t-f.STTO  I  4.44377  * 

a  t 

33.11  t 

1.74 

t 

3337.74  i-4.0tS4  h 

211.33  t 

•4.14 

« 

5447.R  t-4.S77R  t  4.14337  i 

a  t 

at.37  t 

4.» 

• 

303.37  I-4.Z73I3  M 

Ztl.O  t 

•4.1Z 

» 

3444.33  t-4.37144  t  4.44337  i 

It  t 

m.i7  t 

3.43 

• 

3444.0  1-4.27131  it 

211.3  t 

•4.11*. 

3444.14  i-4.3n47  i  4.t4M  i 

U  t 

lt4.M  t 

4.W 

• 

3347.0  I-4.3R4I  it 

211.17  1 

•4.0 

S40.R  1-4.37772  i  4.(110  * 

17  t 

173.31  t 

I.a 

• 

3442.77  1-4.33474  it 

Ztl.24  t 

•4.11 

• 

3443.0  »-4.37R3  t  4.442t3  • 

tMttltttttlUtttttttMtltttttltttMttttttttttWttttttmtttlltttttttHttHMttMtttttltWtMtMtmttttMMHUM 


136 


•  amnuKE  moiCTivc  aiiiitt  conrMisoa  < 

•  TW  MIA  FfitSENTEO  KLQV  IS  FM  CASCI  ]4  Wiai  HAS  AH  OSSavCI  VALUE  Of)  ZK.N 

•  t  >  Sttuctt  (UARAtlK  CKVEI  AOSEL  •*  FUIL  (OOUMVE  moouCTIOA  t  ntOOUCTIM  RATE)  RCa 


*  CASES 

«  tSEB  •  nCBICTICa  <  :  UCVIAtllUl  •  EST  N  •  EST  II  M  PKEIICTIiM  4  I  KVIATION  4  Esr  M  4  ESI  II  4  EST  U  < 

444H4444444444M44444 44 444444444444 444H4444444444444444f44444444444444444444H44444444444444444444444444444M4444l 


u 

• 

311.13 

1 

1.33 

4 

3144.11  1-1.31334  •• 

313.74 

1 

1.12 

• 

SU4.44  •-8.54414  »  8.14544 

» 

• 

3Il.n 

« 

1.44 

4 

3131.43  »-l.:t337  u 

313.73 

• 

8.12 

• 

5444.48  •-I.SSttl  •  8.14553 

31 

• 

311.74 

« 

1.33 

4 

3133.34  «-4.33M4  «• 

313.73 

• 

1.13 

5U4.4I  •-4.54488  •  8.14343 

M 

• 

3II.S3 

• 

1.43 

4 

3143.71  M.3t434  <* 

213.73 

• 

8.13 

f 

SU4.t4  •-8.34418  •  8.14353 

n 

« 

311.31 

I 

1.73 

4 

3t73.U  •-I.39443  »• 

213.74 

l.ll 

1 

34a.33  •-8.344I3  •  8.14578 

n 

• 

IM.W 

4 

1.17 

4 

3184.44  ••1.38313  •• 

213.73 

• 

8.12 

• 

3441.48  •-4.34484  •  4.14354 

n 

» 

3«.St 

4 

3.M 

4 

3141.11  •-1.0371  •• 

213.71 

• 

8.13 

• 

S4M.S4  •-4.34843  •  8.34583 

u 

• 

314.31 

4 

3.34 

4 

331I.U  •-4.33438  •• 

313.71 

• 

8.13 

« 

34a.^  •-8.S4844  •  8.14383 

n 

* 

3n.ii 

1 

3.43 

4 

3334.0  •-I.247I3  •• 

313.74 

« 

8.13 

• 

54a.8t  •-8.34481  •  8.84331 

34 

• 

311. 11 

4 

3.73 

4 

3344.41  •  1.28744  •« 

313.73 

• 

8.13 

• 

SU7.7I  •-4.34848  •  8.84443 

33 

1 

317.43 

4 

I.IT 

4 

3348.43  •-1.28414  •• 

213.n 

• 

8.12 

1 

3U7.73  •H.34844  •  8.84328 

a 

• 

314.44 

1 

3.31 

4 

3248.34  •-1.24833  •• 

313.78 

• 

8.18 

• 

54U.78  •-8.54428  »  8.14*47 

3t 

313.17 

4 

4.13 

4 

3334.74  •-8.24234  •♦ 

213.75 

« 

8.12 

• 

SU7.42  *-4.54483  •  8.14537 

31 

♦ 

313.44 

4 

4.44 

4 

3343.84  •-8.24313  •• 

3I3.U 

8.14 

• 

5444.33  •-8.S4848  •  8.84334 

IS 

• 

311.14 

4 

4.11 

4 

34U.I8  •-8.24833  •* 

313.47 

8.15 

« 

5444.14  •-8.34344  •  8.I43U 

II 

• 

143.51 

4 

7.34 

4 

3344.33  •-8.38340  •• 

313.57 

1 

1.28 

« 

3448.83  >-8.54772  •  8.l4tn 

17 

143.37 

4 

3.41 

4 

3443.44  >-1.30478  •• 

213,44 

1 

8.17 

I 

5443.34  •-8.54833  •  8.14343 

li 

1 

143.14 

4 

11.14 

4 

3751.44  •-8.31I41  •♦ 

213.53 

« 

8.23 

• 

5437.43  >-8.54748  •  8.14824 

4444444I4M4H  4444444444444444H44444H44444444MM444444444444H4444444444H4444H444H44444444444444M44444M4M4I 


4444444M444m444444444444444H44H444444444444444444444444444444444444444444444H444444444444444444444H4444H4444 

«  StflRTRAIKE  FICBtCTIVE  ASILITT  COiVARISOA  4 

*  THE  MTA  FRESENTEB  KLOU  IS  FOA  CASE  F  R  IMICA  HAS  AA  OISERVtO  VALUE  OF:  :t4.lf  4 

44 4444444MH44444444444444444444H44444444H44444444444444H4444444444H4444H444444444444444444444444H44 444444444 

«  I  •  KEIUCED  (LEARAtlK  CUKVE)  HCOa  M  FUU  (CUmUTIVE  mOUCTIM  t  PKOOUCTtOn  RATE)  HODEL  4 

*  CASES  4H444444444444444444444U44444444444444444444444444444444444HM44444H444444444444444444444444444444444M4 

*  ISEI  4  FREIICnm  4  I  OEVtATIM  4  EST  SI  4  EST  St  h  PREOtCTlOA  4  1  OEVIATtOil  4  EST  SI  4  EST  St  4  EST  K  4 

444444 444444N4444444H44444444444H4444H4444H444444444H4H444444444444444444H4 44444 44444444444444444 44444444444 


32 

211.13 

• 

1.33 

• 

3151.43  •-8.28357  •• 

213.48 

« 

1.13 

1 

5444,41  >-8.54418  •  l.$43S3  • 

11 

312.45 

« 

1.41 

1 

1158.24  •-I.2S384  •• 

313.84 

« 

8.13 

• 

5444.41  >-8,34481  •  8.14341  • 

18 

» 

313.74 

• 

1.51 

« 

1143.78  •-8.28424  •• 

313.48 

• 

8.83 

« 

3U4.44  *-8.34418  •  8.84332  * 

3T 

1 

313.31 

« 

1.41 

« 

3173.U  •-8.2S442  •• 

313.43 

8.81 

• 

5448.33  •-8.34412  •  8.14378  • 

31 

1 

213.28 

• 

1.74 

• 

1184.44  •-8.285I3  •• 

313.43 

1 

8.14 

1 

3441.41  >-8.54484  •  8.84554  * 

n 

» 

311.18 

• 

1.44 

f 

3148.18  •-8.23378  •• 

213.88 

« 

8.84 

• 

34U.3I  •-8.54S45  •  8.14383  * 

34 

« 

311.43 

1 

2.12 

• 

3218.44  •-8.284U  •• 

313.88 

I 

8.84 

t 

3448.48  >-8.34844  •  8.84583  * 

25 

» 

211.83 

« 

3.11 

1 

3324.28  •-8.2I783  •• 

313.41 

1 

8.84 

« 

5448.81  •-8,54481  *  8.84331  • 

31 

t 

218.41 

« 

3.54 

« 

33W.48  >-8.28744  t* 

213.88 

• 

8.13 

1 

5U7.78  •-8.34848  •  8.84441  • 

31 

1 

384.45 

• 

3.44 

• 

1348.43  >-8.28414  •• 

213.41 

1 

8.84 

• 

5U7,73  >-8. 54844  •  1.84328  • 

33 

• 

218.71 

1 

1.33 

« 

3348.24  >-8.24058  •• 

213.43 

1 

1.83 

• 

5448.71  >-8.54428  •  8.14347  • 

31 

1 

217.34 

1 

1.44 

3334.74  •-I.24254  •• 

213.41 

« 

8.84 

1 

SU7.43  •-I.544I2  •  8.84337  • 

21 

• 

3IS.U 

» 

4.74 

t 

1341.84  •-8.24313  •♦ 

213.13 

1 

8.81 

ff 

3444.33  •-1.34148  •  8.84334  * 

It 

t 

383.34 

1 

5.S3 

1 

3444.81  •-8.24SS3  •• 

213.84 

» 

8.88 

• 

3444.84  >-8.54844  •  8.84344  • 

11 

• 

311.73 

I 

7.17 

« 

3344.33  >-8.31248  •« 

313.74 

♦ 

1.13 

• 

3448.83  *-1.54773  •  8.84127  • 

17 

1 

147.74 

1 

8.43 

f 

3442.44  •-I.3I47I  •• 

213.81 

« 

1.84 

•  1 

5443.34  •-8.S4I33  •  8.84243  « 

14 

1 

144.41 

1 

18.88 

« 

1751.44  •-8.3I141  •• 

213.44 

1.14 

• 

5437.43  •-8.34748  •  8.84834  • 

IS 

• 

148.48 

• 

11.43 

1 

38U.18  •-8.11444  •• 

213.74 

« 

1.12 

« 

3448.84  >-8.34774  *  8.84133  • 

44444444444444444444444444444 4444444444444444444444444444H444444HI44444444444H444444444H44444444444444444M44444 


137 


fmCTtVI  AllLITT  COTiKSn  # 

nc  can  ncmn  lan  u  n»  case  a  a  «tca  Has  la  oasano  mm.  qf<  tts.ia  i 


f 


Knea  aiMMnccoRf)  ana 


It  RU  (coRuriHC  nNaacTtoa  t  nogacTioa  lam  asaa  i 


«  «sa  t  raatenoa  i 

i  scttniM  1  tr  u  1  (ST  It  It  rcaiaioa  1 1  ocvtariM  t  or  n  i  ui  ii  t  est  r  t 

«  11  «  asjt  « 

i.a 

1  itst.u  M.aat  It 

a7.ii  1 

I.M  1  SUt.n  I'l.SIIN  1 1.1041 1 

M  » 

as.ii  t 

tJS 

1  114S.7t  l•I.W14  H 

a7.n  1 

I.M 

« 

SUt.44  M.S1tll  1  1.14532  i 

n  1 

a4.it  * 

1.0 

«  1173.44  l•44344:  H 

117.15  t 

1.12 

t 

34U43  W.ntU  t  I.M37I  i 

a  t 

a4ji  « 

I.ST 

«  1114.44  M.aSll  U 

a7.i4  t 

I.n 

1 

5441.0  1-1.31111 1 1.I4SS4  • 

a  * 

a4.ii  t 

i.n 

t  aia.ti  M.a37s  It 

a7.ia  » 

I.n 

t 

54M.a  t-4.3tt13  t  I.S4a3  i 

a  t 

m.n  • 

i.n 

t  RU.UH4S4ail 

a7.n  t 

i.n 

1 

3441.0  t-«41t14  t  I.M3I2  t 

a  t 

a3.M  I 

ati 

t  ia4.a  i-i.a7K  It 

a7.i3  t 

I.n 

1 

54U.S1  i-l4Tm  t  l.tOll  t 

a  t 

at.a  t 

tM 

t  R44.4a  i-«.a7tt  M 

a7.li  t 

I.M 

1 

3447.n  i-I.S1«1l  1 144413  t 

a  t 

m.a  t 

1.74 

1  3241.0  t-44ltl4  It 

a7.n  1 

i.n 

1 

3447.R  M.SItlt  1 1.1450  t 

a  t 

ai.it  1 

3.17 

t  12tl.aM4N3lM 

ar.H  t 

1.12 

• 

344l.n  t-«4mi  «  1.4450  t 

n  t 

at.n  t 

].» 

1  lllt.74  t-f.2n34  It 

a7.i3  t 

i.n 

t 

5447.12  i-f.lltn  1  1.14537  » 

a  f 

aijt  t 

447 

t  13t3.lt  i-l.2ni3  H 

217.14  t 

1.17 

1 

344443  I-I4n4f  1  1.34331  t 

n  « 

a3.74  « 

S41 

t  1444.M  t-l.2T«3  H 

a7.t4  1 

1.17 

« 

3444.M  1-141141  1  1.14344  t 

la  t 

ai.ii  t 

441 

t  S4T.a  tH4R4l  H 

217.74  t 

1.11 

1 

344I.R  1-1.31772  t  I.MIR  i 

n  « 

aa.i7  « 

I.I3 

1  3442.tt  M4a47l  it 

a7.i3  t 

I.n 

t 

344341  t-«.3m3  t  I.M213  t 

U  t 

m.»  t 

t.n 

t  3731.14  M4114I  » 

a7.7i  t 

1.13 

1 

3437.12  i-l.304f  t  |.MI»  t 

IS  • 

tt3.a  • 

1144 

t  314441  t-«4U4t  H 

a7.74  t 

1.11 

t 

3441.14  t-|.3074  i  I.M132  t 

14  » 

tit.ii  « 

lan 

t  im.it  M4aa  It 

a7.42  t 

I.U 

I 

343441  I-I.3147I  t  }.i:in  t 

ttMIMl 


saamaatc  moterm  miun  taraaisoa 
V  Mia  ncsaiu  lan  t$  m  casci »  nia  aas  m  oaitna  wuk  v> 

wniiiiMttiiiiMimmi 


m.aa 


HII»HHI«WttMt«MIMIMI«IMIHI«m<MIM>lll>mtiHHMHIHIMHIHttllt 


onco  oaniae 


caNQ  ma 


H  r<u.  (OiRiiTtM  wsaKTiw  t  nam:n  »iq  mca  • 


t  mat 

noiCTiaa  1 1  Ktiaiioa 

1 

ESTM  tcsTii  14  naicnoa  4 1  GCtunoa  t 

Esr»  lEsrst  4  ESI  a  4 

t  a  t 

211.11 

t 

141 

t 

314S.n  4-1.0424  14 

mM 

t 

-4.n 

1 

3444.44  M.Snt4  4  1.34332  i 

1  a  t 

07.11 

« 

1.41 

t 

31044  4-141442  H 

20.11 

4 

H.n 

1 

S4U.33  4-4.Sm:  4  4U07I  1 

t  a  t 

n7.a 

f 

143 

« 

»M.44  4-1.28313  M 

20.11 

« 

•4.N 

1 

34M.4f  4-4.31111  4  4.34334  4 

t  S  t 

a7.ii 

t 

1.73 

t 

013.11  4-1.23371  H 

20.44 

t 

•4.43 

4 

3443.^  4-4.31313  l  1.84333  i 

t  a  t 

04.11 

I 

I.W 

t 

R1I44  1-1.23433  h 

20.14 

I 

•4.11 

1 

3441.0  4-4.31114  1  4UOR  4 

t  a  1 

2U.M 

t 

2.n 

t 

3224.a  H.237I2  H 

221.11 

1 

•4.M 

4 

3141.11  MJini  1  4.34311  i 

t  24  t 

213.71 

t 

244 

t 

3244.0  4-1.23711  m 

20.14 

4 

•4.0 

f 

S447.n  4-4.3m3  4  4.34413  i 

4  a  t 

as.M 

1 

2.a 

1 

3243.0  1-1.28114  M 

20.11 

« 

•4.H 

I 

S447.n  1-4.31811  1  f.M3a  i 

t  a  t 

04.1# 

« 

3.a 

1 

321t.»  1-1.21131 14 

m.u 

1 

•4.14 

« 

3143.0  4-4.S1TO  4  1.14317  i 

t  a  1 

02.0 

I 

1.72 

t 

1331.74  1-1.21234  i4 

20.11 

• 

•4.M 

4 

S447.R  4-4.311R  i  I.M337  # 

t  a  1 

ni.i4 

4 

441 

4 

330.31  I-I.21S13  It 

20.11 

• 

•4.14 

4 

3144.0  4-4.Sm4  4  1.14331  i 

t  It  t 

ai.74 

t 

544 

4 

3444.M  1-1.21133  » 

20.12 

1 

•4.11 

1 

3144.14  4-4.31841  4  f.l43U  4 

t  11  t 

ai.u 

« 

4.n 

4 

3341.33  4-IJ8tM  it 

20.12 

• 

1.34 

4 

34tf.42  4-4.31772  •  I.M127  4 

t  17  t 

a3.ia 

t 

144 

4 

1442.11  i-l  jnn  14 

2a.ll 

1 

1.11 

4 

3443.31  4-4.3130  t  4.M213  4 

t  14  t 

11t.M 

» 

i.a 

• 

1751.14  i-#4ll4t  14 

2a.l7 

4 

1.14 

4 

34S7.R  4-4.37741  i  l.t4R4  4 

t  U  t 

tit.a 

* 

11.11 

ff 

»U.a  1-44101  II 

2a.12 

« 

I.M  4 

« 

3444.14  4-4.31774  4  1.14132  i 

t  14  t 

112.M 

t 

U.74 

4 

3m  .M  1-442171  II 

2a.n 

« 

I.U 

4 

3434.33  1-4.31478  4  ).|38n  i 

t  13  t 

ttf.U 

1 

4m 

14.13 

• 

•N 

033.0  1-44240  » 

■A  aA-A  ^  A  m  ^  M  A  »  m  M  ^  M  4^ 

■  •■tpaiaa  www 

20.13 

* 

m« 

IJ7 

mM«*m 

6 

3434.43  1-4.31711  i  I.331SI  4 

138 


SmiUSR  RfDiaiVt  MIIIIT  CCT.’IMISM  I 

nz  nn  PKR»m  klm  is  f«  um  3i  »iai  hm  m  osservo  vrlue  cf:  ct.i:  i 

HI44l4l*444l4444444*44444*4l4t4ll4l44444l4444M4«4444Mf44444l444444:44444444>444l444444*4>l«4ll44l4t<l4l4IH44ll* 

I  *  Kouca  (UKatRc  cumti  nasa  **  rai  (cmATivE  KfiocTiw  t  ntrsocTiiM  mtei  icxcl  i 

USES  IH4IM4H444444l4*4444*444<*l4*444»M44444«44t444444l4H44l«l4444l«444444*444444HI*4«4MH444*444l»*44M4« 
USES  4  fSEOICTtM  >  I  OEViniM  4  EST  SC  •  EST  It  44  PSCOiai'n  4  I  OEVIATISN  4  ESI  N  4  ESI  It  4  ESI  St  4 
44444444444444444444444444II4I444444444444444444444I4444444444444I44444444H444444444444444444444H44444444MH4444 


n  4 

01.84 

« 

t.3Z 

• 

3tn.U  4-I.Z8UZ  H 

04.37 

• 

-8.17 

ft 

UU.31  4-f.S111Z  4  8.84378  4 

n  4 

za.74 

• 

t.U 

3184.44  4-f.ZS3t3  44 

04.38 

« 

•1.18 

ft 

38U.43  4-8.31181  4  8.8«3U  4 

a  4 

ZZf.34 

1 

t.U 

• 

3t18.ll  4-8.Z8S78  44 

04.3Z 

« 

•1.14 

4 

3U8.S8  4-8.31813  4  8.84313  4 

U  4 

zti.n 

• 

1.18 

« 

3Zlf.U  4-1.13838  44 

04.n 

•f.l4 

ft 

S8U.U  4-1.31314  4  8. MUZ  4 

ZS  4 

zti.u 

1 

1.18 

t 

304.0  4-f.Z37n  44 

04.33 

« 

•1.18 

ft 

S8U.ft  4-8.31181  4  8.84331  4 

»  4 

ZII.1S 

« 

Z.ZA 

» 

3Z44.48  4-8.Z8711  44 

04.33 

•8.13 

ft 

S887.)t  4-1.31818  4  «.|4«13  4  ' 

a  4 

zti.a 

• 

Z.S1 

1 

3ZU.43  4-|.nit4  44 

04.33 

4 

•1.18 

4 

SU7.73  4-1.31811  4  8.84SZI  4 

a  4 

Z17.U 

» 

3.11 

• 

3Z1t.n  4-f. 11138  44 

04.31 

•1.17 

ft 

S8U.7I  4-3.31178  4  8.14377  4 

Zl  4 

ZI3.13 

« 

3.31 

• 

3331.78  4-|.Z1tU  44 

04.38 

•f.l8 

ft 

S847.1Z  4-1.3118:  4  I.S4S17  4 

a  4 

Zt4.Z3 

4.U 

t 

3313.11  4-f.Z1313  44 

04.ZT 

» 

•f.tZ 

ft 

3884.33  4-8.31849  4  f. 84331  4 

t1  4 

Ztl.13 

« 

SJ1 

« 

34W.ft  4-8.0833  H 

04.Zt 

• 

•f.13 

ft 

3484.84  4-1.31341  4  8.84348  4 

It  4 

ZI1.3I 

t 

i.U 

1 

3U1.33  4-8  J8Z4f  h 

04.18 

•8.38 

ft 

38U.fZ  4-8.31771  4  8.8410  4 

17  4 

ZM.3A 

• 

7Jt 

« 

384Z.11  4-f  JU7f  44 

04.73 

• 

•f.ll 

ft 

38U.31  4-f.313Z3  4  f.84Z13  4 

U  4 

ZR.17 

t 

1J1 

« 

3731.14  4-f.3tt8t  44 

04.14 

« 

•1.18 

ft 

US7.1Z  4-8.31748  4  f.84fZ8  4 

IS  4 

t11.45 

* 

11.18 

38U.3I  4-|.3tU1  H 

04.18 

ft 

•f.M 

ft 

S8U.f8  4-1.51774  4  (.8413Z  4 

t<  4 

tis.u 

« 

iz.a 

• 

3181.18  4-f  JZl7f  44 

04.14 

ft 

•1.0 

ft 

SU4.3I  4-8.31878  4  f.838Z7  4 

13  4 

m.ii 

• 

i3.n 

« 

4183.78  4-f.3Z8Zf  44 

04.11 

ft 

•f.fS 

ft 

UU.43  4-8.31718  4  I.831U  4 

a  4 

118.71 

M.e 

« 

4t3Z.4Z  4-f. 31188  M 

04.43 

ft 

•1.0 

ft 

3U3.31  4-8.31878  4  f.|4411  4 

44M444  44  H4444444444444444444M4 44444444441444444444444444444444444444444 4HII44444444IIH4444H4444 4444444 444H  444 

44M444444HM44444444I444W  4444I44444W44MM444444I4H  44444H44444HWI44444I444I4444444444I4444  M44M  44444444444 

SHUIRMCE  FRE9ICIIVE  MtltH  CSnMRlSOX  4 

>  IK  Mil  riESElIES  laOII  IS  FOR  CASE  t  tt  VHICM  HAS  AN  4I!SERVEI  VRLUE  0F<  01.11  4 

44444444M444444444444444444444M44444444444444444444H44444444  H444HH444444444444444H  44444444444444444444444444 

>  ^  4  RESOCn  OiARRinC  CURVE)  moa  H  FOI  (CiniUIlVE  FROMCIIGN  t  PRStRICTION  RATE)  csea  4 

I  VSH  4  nOICTlM  4  t  SEVIAIin  4  EST  M  4  ESI  It  44  rRE01CTI09  «  Z  BEVIATIOa  4  ESI  If  4  QI  It  4  ESI  It  4 

4  )4444444444444t444444H44444444444444444444444H4tl44l444444t4M4444Wt44l4MM444H444H44444444 44444444444444444 


a 

4 

04.18  4 

1.73 

ft 

3184.44  4-f.U313  44 

zn.t7 

ft 

8.88 

ZT 

4 

ZZ3.87  4 

1.18 

ft 

310.11  4.f.K378  44 

ZZ7.84 

ft 

f.f7 

a 

4 

zn.u  4 

Z.I8 

ft 

3Z1I.U  4-8.0838  44 

777.84 

ft 

1.87 

a 

4 

ZO.t1  4 

0Z4 

ft 

304.0  4-8.ZS7IZ  44 

ZZ7.88 

ft 

8.88 

a 

4 

zo.a  4 

Z.SI 

ft 

3Z44.4f  4-8.18711  44 

zn.84 

ft 

8.17 

Z3 

4 

01.34  4 

Z.I4 

ft 

3ZU.4S  4-8.0114  H 

20.37 

ft 

8.M 

o 

4 

za.u  4 

3.0 

ft 

3Z18.Z1  4-8.0CU  44 

70.11 

ft 

1.84 

n 

4 

zii.a  4 

3.SZ 

ft 

3331.78  4-f.Z1ZU  44 

70.87 

ft 

8.88 

a 

4 

Z17.37  4 

4.U 

ft 

3313.81  4-1.21313  44 

20.78 

ft 

8.18 

11 

4 

03.77  4 

S.U 

ft 

34W.f8  4-8.0833  H 

70.71 

ft 

f.tl 

18 

4 

nz.M  4 

8.74 

ft 

3U1.33  4-f.38t4t  H 

70.81 

ft 

8.13 

17 

4 

ai.7i  4 

8.13 

ft 

384Z.11  4-9.38878  44 

20.78 

ft 

f.tf 

18 

4 

08.31  4 

1.31 

ft 

3731.14  4-8Jtl8t  44 

ZO.U 

ft 

8.13 

13 

4 

at.7i  4 

11.18 

ft 

3tU.3l  i-f  J1U1  H 

Z0.7f 

ft 

8.13 

14 

4 

m.n  4 

lZ.Sf 

1 

3181.88  4-f.3Z178  44 

70.33 

ft 

8.0 

13 

4 

118.14  4 

13.17 

ft 

4813.78  4-8  JZAZf  44 

07.8Z 

ft 

8.17 

IZ 

4 

114.11  4 

14.U 

ft 

4ISZ.4Z  4-8  JZ1f8  44 

70.18 

ft 

1.82 

11 

4 

114.83  4 

14.81 

ft 

4134.81  4-8.37113  44 

20.88 

ft 

8.83 

4  SMS.<f  4-|.SV1fV  4  f.84SM  4 
4  SAM.Sf  4^.SV(V3  4  I.SIZAS  4 
4  3A4I.4R  4-f.3VtV<  4  f.gASft  4 
4  UU.lt  4.4.3Wft  4  |.M5$t  4 
4  SU7.7I  4-f.3VSVf  4  f.U4V3  4 
4  3U7.73  4-#.3VW  4  |.843tl  4 
4  SSU.7I  4^.3WZf  4  I.S43V7  4 
4  3U7.fZ  4-f.S7tK  4  1.14337  i 
I  SU4.33  4-4.3VS4I  4  f. 14331  4 
4  SU4.84  4-f.3VS4V  4  f.843U  4 
4  3AU.ft  4-f  .SVTTt  4  }.84tt7  4 
4  3AU,3V  4-f.SV8t3  4  f.f4a3  4 
4  3AS7,Vt  4H.3V74I  4  f.UKA  4 
4  3UI.H  4-«.SfT74  4  f.84t3t  4 
4  3434.38  4-f.3V478  4  f.80Z7  4 
4  34U.43  4-8.3V7t8  4  f.S3V38  4 
4  3U3.3t  i-f.3VI7l  4  |.$44VT  4 
4  3iU.U  4-8.31883  4  8.84411  4 


14444  444444444 44444444t4HH4444444«  44444414414444444444 4444444W44I444 4444  l444N44444t44H4444l444t»44444«444«Wt4 


I 


139 


•  AVERACE  ABSOLUTE  DEVIATIOR  » 

1.21 

m 

•  TTARIANCE  OF  ABSOLUTE  OEVIATIQNS  • 

11S.4S  « 

f.fZ 

«  TEST  STATlsnC  (SEE  ROTEI  • 

—  » 

W.IV 

«  TOTAL  RUKBER  OF  TEST  SnOATlORS  » 

324  • 

324 

•  HORBER  OF  PREBICTIQRS  UITHIR  SZ  • 

214  * 

324 

<  PERCEir  OF  PREBICTIORS  UITHIR  SI  * 

iZ.  • 

Iff. 

»  RUBBER  OF  PREBICTIORS  BITRIR  IIZ  • 

2il  • 

324 

«  PERCENT  OF  PREBICTIORS  UITHIR  tfZ> 

Of.  * 

Iff. 

IWTEI  n  TESTWC  FOR  STATISnOL  SICRIFICMCE  OSE  STO0E»T»S  T  BISTHIBOTIW 
IF  TME  RUIKR  OF  TEST  STTOKnORS  ARE  LESS  TIMN  MT  UTHERRISE  USE  STANOARO 
RORIIRL  OISTRIBBTIOR.  IR  EITHER  CASE  THIS  IS  A  ORE  TAILEB  TEST.  IF 
TK  TEST  STATISTIC  IS  CSEATER  THAR  THE  CRITICAL  STATISTIC  ORE  RAT 
aRCmOE  THAT  THE  AVERACE  ABSOLUTE  BEUIATIOR  OBTAIREB  UITH  THE  FUU. 

HOBa  IS  SICRinCARILT  LESS  THAN  THAT  OBTAIREB  UITH  THE  REBUCEB  ROBB.. 
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APPENDIX  B 
MULTICOLLINEARITY 
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The  purpose  of  this  appendix  is  to  pull  together 
some  observations  and  references  about  multicollinearity. 
The  information  is  separately  recorded  from  Chapter  III  to 
expand  the  necessary  treatment  of  multicollinearity 
without  burdening  the  reader  with  unnecessary  detail. 

The  comments  assume  familiarity  with  multiple  linear 
regression  as  a  statistical  tool,  and  should  be  read  in 
conjunction  with  the  comments  about  multicollinearity  in 
Chapter  III. 

Multicollinearity  is  defined  (18:340)  as  the  con¬ 
dition  existing  in  multiple  regression  analysis  when  two 
or  more  of  the  independent  variables  are  highly  inter- 
correlated.  It  was  noted  in  Chapter  III  that  one  of  the 
assumptions  of  this  research  was  that  the  varying  degrees 
of  multicollinearity  did  not  importantly  impair  the 
models'  short-range  predictive  ability.  Other  notable 
references  are  as  follow: 

1.  Congleton  and  Kinton  (8:33)  and  Smith  (21:46) 
assumed  that  multicollinearity  did  not  impair  predictive 
ability. 

2.  Spurr  and  Bonini  (22:612)  reaffirmed  the  unre¬ 
liability  of  a  regression  coefficient  under  conditions  of 
multicollinearity,  as  cited  in  Chapter  III  under  a  dif¬ 
ferent  reference  (17:341).  Spurr  and  Bonini  also  stated 
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that  multicollinearity  may  not  affect  the  model's  ability 
to  predict  (22:612).  Put  another  way,  the  standard  error 
of  the  estimate  (which  is  essentially  the  standard 
deviation  of  the  residuals)  may  well  be  the  same  as  if 
there  were  no  multicollinearity.  This  can  hold  true 
because  the  sampling  errors  of  each  coefficient  (in  a 
model  with  two  independent  variables)  tend  to  cancel  each 
other  (22:611). 

As  noted  in  Chapter  III,  multicollinearity  is 
likely  to  be  present  in  business  and  economic  data 
(17:255).  It  was  present  in  this  research,  but  as  in  the 
usual  case  (17:345)  it  created  no  problems  in  predictive 
ability.  But  it  could  have.  In  fact,  multicollinearity 
can  pose  problems  so  severe  that  repareuneterization  or 
omission  of  a  variable  becomes  necessary  to  increase  com- 
putational  accuracy  (17:346-351).  Moreover,  had  the 
scope  of  the  research  been  more  extensive  (e.g.,  less 
emphasis  on  predictive  ability  and  more  on  assessment  of 
individual  independent  variables) ,  multicollinearity 
could  have  posed  formidable  problems. 

Finally,  a  thought-provoking  phenomenon  which 
occasionally  occurs  in  regression  analysis  in  the  pres¬ 
ence  of  multicollinearity  is  the  change  of  sign  in  the 
regression  coefficient.  For  example,  if  B],  were  cumula- 

e 

e 

tive  output  and  B2  were  production  rate,  a  hypothetical 
result  might  be  as  follows.  Assume  B2  entered  stepwise 
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regression  first  (being  forced)  and  showed  a  bivariate 
coefficient  of  -0.5.  Further  assume  was  then  entered 
in  the  regression,  and  the  B2  partial  coefficient  became 
■^0.5.  The  question  of  why  this  change  occurred  must 
arise. 

The  change-of-sign  phenomenon  was  reported  by 
Smith  (21:134)  in  association  with  his  analysis  of  the 
KC-135A  data.  Smith  (21:142-144)  attributed  this  phenom¬ 
enon  in  the  B2  coefficient  to  the  combined  effects  of 
highly  correlated  independent  variables  and  the  over¬ 
powering  strength  of  the  other  (X^)  independent  variable. 

Spurr  and  Bonini  (22:611)  described  the  change  in 
sign  phenomenon  as  a  peculiar  result  of  multicollinearity . 
Moreover,  the  peculiar  result  and  the  reason  for  it,  as 
discussed  by  Smith  and  supported  by  Spurr  and  Bonini,  was 
corroborated  by  Nie  and  others  (18:330)  as  follows: 

It  is  worth  noting  at  this  point  that  the  relative 
magnitude  of  the  partial  regression  coefficient  of 
an  independent  variable  can  be  quite  different  from 
its  bivariate  regression  coefficient  with  the  depen¬ 
dent  variable  since  the  bivariate  coefficient  is 
confounded  with  the  effects  of  other  correlated  inde¬ 
pendent  variables. 

At  least  one  example  of  the  change-of-sign  phenom¬ 
enon  occurred  in  this  research.  During  data  analysis  in 
that  instance  the  B2  coefficient  when  the  production  rate 
variable  entered  regression  first  was  -0.583  as  reflected 
in  Figure  3.  Subsequently,  following  addition  of  the  cumula¬ 
tive  output  variable  to  the  regression,  the  B2  coefficient 
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Fig.  3.  Summary  of  Results  of  Regression 
on  Production  Rate  Variable  Alone 

NOTE:  Masked  denotes  proprietary  data. 


became  ■»'0.289  as  is  observed  in  Figure  4.  This  algebraic 
change  of  more  than  0.3  resulted  from  the  addition  of  the 
cumulative  output  variable  to  the  regression  in  which  the 
production  rate  variable  was  already  present.  The  change 
in  magnitude  and  sign  of  the  coefficient  were  attributed 
to  the  multicollinearity  between  independent  variables 
and/  for  the  model  which  was  being  investigated,  the  over¬ 
powering  strength  of  the  cumulative  output  variable.  The 
multicollinearity  present  in  this  particular  analysis  is 
evidenced  in  Figure  5  where  it  is  observed  that  the  corre¬ 
lation  of  cumulative  output  and  production  rate  is  greater 
than  0.97. 

The  following  summary  statements  are  offered,  there¬ 
fore,  as  support  of  prior  investigation  and  existing 
theory. 

1.  The  occurrence  of  multicollinearity  is  not  uncom 
mon  in  business  and  economic  data.  In  this  reasearch 
multicollinearity  was  evidenced  by  the  high  correlation 


147 


THE  EQUATION  FON  THIS  MOa  IS)  THAT  *  II  *  11  H  11  f  IZ  h|Z 
IN  LOC  FOffl  THIS  MOEL  SCCOHES:  LQC(TKAT)  •  LQGdll  *  It  *  LOGCUl  »  BZ  «  IQCdZl 
HHEREi  LOCIN)  ■  RASXEO  STO  ERMA  «  I.I473I  N  >  RASKED 

II  «  RASKEO  STI  ERROR  •  I.I37S7  F«  ■  3Z.7Z27 

IZ  *  I.Z373I  STD  ERROR  *  M1481I  F*  >  3.8171 

SURRART  STATISTICSt 

R  SQUARED  LOC  >f.87i#Z  STD  ERROR  EST  *  1.1437 

RSE  ■  f.Nt7Z  RSR  ■  1.27837 

F  RATIO  >  135.1171  0.  F.  IN/01  >  2/  34 

R  SQUARED  ACTUAL>I.8Z787 


Fig.  4.  Sununary  Results  of  Regression  on 
Production  Rate  and  Cumulative  Output 

NOTE:  Masked  denotes  proprietary  data. 
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Pig.  5.  Pearson  Correlation  Coefficients  Matrix 
NOTE:  Masked  denotes  proprietary,  data. 


b«twe«n  the  production  cate,  the  variable  of  primary 
research  interest,  and  the  cumulative  output. 

2.  While  multicollinearity  does  affect  the 
reliability  of  partial  regression  coefficients,  it  does 
not  necessarily  affect  the  model's  ability  to  explain 
variation  in  the  dependent  variable. 

3.  Multicollinearity  can  be  enough  or  a  burden  to 
cause  remedial  measures  such  as  omission  of  a  variable  or 
reparameterization  to  improve  computational  accuracy. 

The  probability  of  this  burden  increases  if  the  purpose  of 
the  regression  is  other  than  prediction,  i.e.,  descrip¬ 
tion,  control,  or  explanation. 

4.  The  "peculiar"  change-of-slgn  phenomenon  is 
not  rare;  it  is  attributable  to  the  synergism  resulting 
from  correlation  of  independent  variables  and  their  dif¬ 
ferent  (perhaps  grossly  different)  strengths. 
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